Dec 06 14:02:18 user nova-compute[75326]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75326) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75326) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75326) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 14:02:18 user nova-compute[75326]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:02:18 user nova-compute[75326]: INFO nova.virt.driver [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 06 14:02:18 user nova-compute[75326]: INFO nova.compute.provider_config [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Acquiring lock "singleton_lock" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Acquired lock "singleton_lock" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Releasing lock "singleton_lock" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Full set of CONF: {{(pid=75326) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ******************************************************************************** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Configuration options gathered from: {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ================================================================================ {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] allow_resize_to_same_host      = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] arq_binding_timeout            = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] backdoor_port                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] backdoor_socket                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] block_device_allocate_retries  = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] block_device_allocate_retries_interval = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cert                           = self.pem {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute_monitors               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] config_dir                     = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] config_drive_format            = iso9660 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] config_source                  = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] console_host                   = user {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] control_exchange               = nova {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cpu_allocation_ratio           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] daemon                         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] debug                          = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_access_ip_network_name = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_availability_zone      = nova {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_ephemeral_format       = ext4 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_green_pool_size        = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] default_schedule_zone          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] disk_allocation_ratio          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] enable_new_services            = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] enabled_ssl_apis               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] flat_injected                  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] force_config_drive             = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] force_raw_images               = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] graceful_shutdown_timeout      = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] heal_instance_info_cache_interval = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] host                           = user {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_build_timeout         = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_delete_interval       = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_name_template         = instance-%08x {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_usage_audit           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_usage_audit_period    = month {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] internal_service_availability_zone = internal {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] key                            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] live_migration_retry_count     = 30 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_config_append              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_dir                        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_file                       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_options                    = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_rotate_interval            = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_rotate_interval_type       = days {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] log_rotation_type              = none {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] long_rpc_timeout               = 1800 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_concurrent_builds          = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_concurrent_live_migrations = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_concurrent_snapshots       = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_local_block_devices        = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_logfile_count              = 30 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] max_logfile_size_mb            = 200 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] maximum_instance_delete_attempts = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metadata_listen                = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metadata_listen_port           = 8775 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metadata_workers               = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] migrate_max_retries            = -1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] mkisofs_cmd                    = genisoimage {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] my_ip                          = 10.0.0.210 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] network_allocate_retries       = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] osapi_compute_listen_port      = 8774 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] osapi_compute_unique_server_name_scope =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] osapi_compute_workers          = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] password_length                = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] periodic_enable                = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] periodic_fuzzy_delay           = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] pointer_model                  = ps2mouse {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] preallocate_images             = none {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] publish_errors                 = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] pybasedir                      = /opt/stack/nova {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ram_allocation_ratio           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rate_limit_burst               = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rate_limit_except_level        = CRITICAL {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rate_limit_interval            = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reboot_timeout                 = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reclaim_instance_interval      = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] record                         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reimage_timeout_per_gb         = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] report_interval                = 120 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rescue_timeout                 = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reserved_host_cpus             = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reserved_host_disk_mb          = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reserved_host_memory_mb        = 512 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] reserved_huge_pages            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] resize_confirm_window          = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] resize_fs_using_block_device   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] resume_guests_state_on_host_boot = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rpc_response_timeout           = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] run_external_periodic_tasks    = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] running_deleted_instance_action = reap {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] running_deleted_instance_timeout = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler_instance_sync_interval = 120 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_down_time              = 720 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] servicegroup_driver            = db {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] shelved_offload_time           = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] shelved_poll_interval          = 3600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] shutdown_timeout               = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] source_is_ipv6                 = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ssl_only                       = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] state_path                     = /opt/stack/data/nova {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] sync_power_state_interval      = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] sync_power_state_pool_size     = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] syslog_log_facility            = LOG_USER {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] tempdir                        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] timeout_nbd                    = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] transport_url                  = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] update_resources_interval      = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_cow_images                 = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_eventlog                   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_journal                    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_json                       = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_rootwrap_daemon            = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_stderr                     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] use_syslog                     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vcpu_pin_set                   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plugging_is_fatal          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plugging_timeout           = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] virt_mkfs                      = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] volume_usage_poll_interval     = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] watch_log_file                 = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] web                            = /usr/share/spice-html5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.auth_strategy              = keystone {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.compute_link_prefix        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.dhcp_domain                = novalocal {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.enable_instance_password   = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.glance_link_prefix         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.instance_list_per_project_cells = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.list_records_by_skipping_down_cells = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.local_metadata_per_cell    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.max_limit                  = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.metadata_cache_expiration  = 15 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.neutron_default_tenant_id  = default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.use_forwarded_for          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.use_neutron_default_nets   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_dynamic_targets = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_jsonfile_path   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.backend_argument         = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.config_prefix            = cache.oslo {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.dead_timeout             = 60.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.debug_cache_backend      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.enable_retry_client      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.enable_socket_keepalive  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.enabled                  = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.expiration_time          = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_dead_retry      = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_password        =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_sasl_enabled    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.memcache_username        =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.proxies                  = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.retry_attempts           = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.retry_delay              = 0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.socket_keepalive_count   = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.socket_keepalive_idle    = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.socket_keepalive_interval = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.tls_allowed_ciphers      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.tls_cafile               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.tls_certfile             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.tls_enabled              = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cache.tls_keyfile              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.auth_section            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.auth_type               = password {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.cafile                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.certfile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.collect_timing          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.cross_az_attach         = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.debug                   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.endpoint_template       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.http_retries            = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.insecure                = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.keyfile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.os_region_name          = RegionOne {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.split_loggers           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cinder.timeout                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.cpu_dedicated_set      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.cpu_shared_set         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.image_type_exclude_list = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.resource_provider_association_refresh = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.shutdown_retry_interval = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] conductor.workers              = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] console.allowed_origins        = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] console.ssl_ciphers            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] console.ssl_minimum_version    = default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] consoleauth.token_ttl          = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.cafile                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.certfile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.collect_timing          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.connect_retries         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.connect_retry_delay     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.endpoint_override       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.insecure                = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.keyfile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.max_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.min_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.region_name             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.service_name            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.service_type            = accelerator {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.split_loggers           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.status_code_retries     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.timeout                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] cyborg.version                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.backend               = sqlalchemy {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.connection            = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.connection_debug      = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.connection_parameters =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.connection_recycle_time = 3600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.connection_trace      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.db_inc_retry_interval = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.db_max_retries        = 20 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.db_max_retry_interval = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.db_retry_interval     = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.max_overflow          = 50 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.max_pool_size         = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.max_retries           = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.pool_timeout          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.retry_interval        = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.slave_connection      = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] database.sqlite_synchronous    = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.backend           = sqlalchemy {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.connection        = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.connection_debug  = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.connection_parameters =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.connection_recycle_time = 3600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.connection_trace  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.db_inc_retry_interval = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.db_max_retries    = 20 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.db_max_retry_interval = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.db_retry_interval = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.max_overflow      = 50 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.max_pool_size     = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.max_retries       = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.pool_timeout      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.retry_interval    = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.slave_connection  = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] api_database.sqlite_synchronous = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] devices.enabled_mdev_types     = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ephemeral_storage_encryption.enabled = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.api_servers             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.cafile                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.certfile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.collect_timing          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.connect_retries         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.connect_retry_delay     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.debug                   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.default_trusted_certificate_ids = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.enable_certificate_validation = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.enable_rbd_download     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.endpoint_override       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.insecure                = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.keyfile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.max_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.min_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.num_retries             = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.rbd_ceph_conf           =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.rbd_connect_timeout     = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.rbd_pool                =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.rbd_user                =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.region_name             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.service_name            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.service_type            = image {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.split_loggers           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.status_code_retries     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.timeout                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.verify_glance_signatures = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] glance.version                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] guestfs.debug                  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.config_drive_cdrom      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.config_drive_inject_password = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.enable_remotefx         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.instances_path_share    =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.limit_cpu_features      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.use_multipath_io        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.vswitch_name            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] mks.enabled                    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.manager_interval   = 2400 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.precache_concurrency = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.remove_unused_base_images = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] image_cache.subdirectory_name  = _base {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.api_max_retries         = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.api_retry_interval      = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.auth_section            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.auth_type               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.cafile                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.certfile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.collect_timing          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.conductor_group         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.connect_retries         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.connect_retry_delay     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.endpoint_override       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.insecure                = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.keyfile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.max_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.min_version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.peer_list               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.region_name             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.serial_console_state_timeout = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.service_name            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.service_type            = baremetal {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.split_loggers           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.status_code_retries     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.timeout                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ironic.version                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] key_manager.fixed_key          = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.barbican_api_version  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.barbican_endpoint     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.barbican_endpoint_type = public {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.barbican_region_name  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.cafile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.certfile              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.collect_timing        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.insecure              = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.keyfile               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.number_of_retries     = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.retry_delay           = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.send_service_user_token = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.split_loggers         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.timeout               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.verify_ssl            = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican.verify_ssl_path       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.auth_section = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.auth_type = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.cafile   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.certfile = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.collect_timing = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.insecure = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.keyfile  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.split_loggers = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] barbican_service_user.timeout  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.approle_role_id          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.approle_secret_id        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.cafile                   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.certfile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.collect_timing           = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.insecure                 = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.keyfile                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.kv_mountpoint            = secret {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.kv_path                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.kv_version               = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.namespace                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.root_token_id            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.split_loggers            = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.ssl_ca_crt_file          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.timeout                  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.use_ssl                  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.auth_section          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.auth_type             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.cafile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.certfile              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.collect_timing        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.connect_retries       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.connect_retry_delay   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.endpoint_override     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.insecure              = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.keyfile               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.max_version           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.min_version           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.region_name           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.service_name          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.service_type          = identity {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.split_loggers         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.status_code_retries   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.timeout               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] keystone.version               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.connection_uri         =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_mode               = custom {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: WARNING oslo_config.cfg [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_power_governor_high = performance {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_power_management   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.device_detach_attempts = 8 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.device_detach_timeout  = 20 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.disk_cachemodes        = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.disk_prefix            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.enabled_perf_events    = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.file_backed_memory     = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.gid_maps               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.hw_disk_discard        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.hw_machine_type        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_rbd_pool        = rbd {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_type            = default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.images_volume_group    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.inject_key             = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.inject_partition       = -2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.inject_password        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.iscsi_iface            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.iser_use_multipath     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_downtime = 500 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_inbound_addr = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_scheme  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_timeout_action = abort {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_tunnelled = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: WARNING oslo_config.cfg [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 06 14:02:18 user nova-compute[75326]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 06 14:02:18 user nova-compute[75326]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 06 14:02:18 user nova-compute[75326]: and ``live_migration_inbound_addr`` respectively.
Dec 06 14:02:18 user nova-compute[75326]: ).  Its value may be silently ignored in the future.
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.live_migration_with_native_tls = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.max_queues             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.migration_inbound_addr = 10.0.0.210 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.nfs_mount_options      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_pcie_ports         = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.pmem_namespaces        = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.quobyte_client_cfg     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rbd_secret_uuid        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rbd_user               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rescue_image_id        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rescue_kernel_id       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.rx_queue_size          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.smbfs_mount_options    =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.snapshot_compression   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.snapshot_image_format  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.sparse_logical_volumes = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.swtpm_enabled          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.swtpm_group            = tss {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.swtpm_user             = tss {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.sysinfo_serial         = unique {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.tb_cache_size          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.tx_queue_size          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.uid_maps               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.use_virtio_for_bridges = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.virt_type              = kvm {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.volume_clear           = zero {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.volume_clear_size      = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.volume_use_multipath   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_cache_path   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.auth_section           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.auth_type              = password {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.cafile                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.certfile               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.collect_timing         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.connect_retries        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.connect_retry_delay    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.default_floating_pool  = public {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.endpoint_override      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.extension_sync_interval = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.http_retries           = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.insecure               = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.keyfile                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.max_version            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.min_version            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.ovs_bridge             = br-int {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.physnets               = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.region_name            = RegionOne {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.service_metadata_proxy = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.service_name           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.service_type           = network {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.split_loggers          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.status_code_retries    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.timeout                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] neutron.version                = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] notifications.bdms_in_notifications = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] notifications.default_level    = INFO {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] notifications.notification_format = unversioned {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] notifications.notify_on_state_change = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] pci.alias                      = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] pci.device_spec                = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] pci.report_in_placement        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.auth_section         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.auth_type            = password {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.cafile               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.certfile             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.collect_timing       = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.connect_retries      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.connect_retry_delay  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.default_domain_id    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.default_domain_name  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.domain_id            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.domain_name          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.endpoint_override    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.insecure             = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.keyfile              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.max_version          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.min_version          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.password             = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.project_domain_id    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.project_domain_name  = Default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.project_id           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.project_name         = service {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.region_name          = RegionOne {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.service_name         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.service_type         = placement {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.split_loggers        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.status_code_retries  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.system_scope         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.timeout              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.trust_id             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.user_domain_id       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.user_domain_name     = Default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.user_id              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.username             = placement {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] placement.version              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.cores                    = 20 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.count_usage_from_placement = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.injected_file_content_bytes = 10240 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.injected_file_path_length = 255 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.injected_files           = 5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.instances                = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.key_pairs                = 100 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.metadata_items           = 128 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.ram                      = 51200 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.recheck_quota            = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.server_group_members     = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] quota.server_groups            = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rdp.enabled                    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.image_metadata_prefilter = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.max_attempts         = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.max_placement_results = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] scheduler.workers              = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.host_subset_size = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.isolated_hosts = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.isolated_images = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.pci_in_placement = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.track_instance_changes = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metrics.required               = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metrics.weight_multiplier      = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] metrics.weight_setting         = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.enabled         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.port_range      = 10000:20000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] serial_console.serialproxy_port = 6083 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.auth_section      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.auth_type         = password {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.cafile            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.certfile          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.collect_timing    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.insecure          = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.keyfile           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.send_service_user_token = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.split_loggers     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] service_user.timeout           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.agent_enabled            = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.enabled                  = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.html5proxy_port          = 6082 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.image_compression        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.jpeg_compression         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.playback_compression     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.server_listen            = 127.0.0.1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.streaming_mode           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] spice.zlib_compression         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] upgrade_levels.baseapi         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] upgrade_levels.compute         = auto {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] upgrade_levels.conductor       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] upgrade_levels.scheduler       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.cafile = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.certfile = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.insecure = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vendordata_dynamic_auth.timeout = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.api_retry_count         = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.ca_file                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.cache_prefix            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.cluster_name            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.connection_pool_size    = 10 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.console_delay_seconds   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.datastore_regex         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.host_ip                 = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.host_password           = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.host_port               = 443 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.host_username           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.insecure                = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.integration_bridge      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.maximum_objects         = 100 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.pbm_default_policy      = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:18 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.pbm_enabled             = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.pbm_wsdl_location       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.serial_port_proxy_uri   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.serial_port_service_uri = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.task_poll_interval      = 0.5 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.use_linked_clone        = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.vnc_keymap              = en-us {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.vnc_port                = 5900 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vmware.vnc_port_total          = 10000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.auth_schemes               = ['none'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.enabled                    = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.novncproxy_port            = 6080 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.vencrypt_ca_certs          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.vencrypt_client_cert       = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vnc.vencrypt_client_key        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.disable_rootwrap   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.enable_numa_live_migration = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.libvirt_disable_apic = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.client_socket_timeout     = 900 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.default_pool_size         = 1000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.keep_alive                = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.max_header_line           = 16384 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.ssl_ca_file               = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.ssl_cert_file             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.ssl_key_file              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.tcp_keepidle              = 600 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] zvm.ca_file                    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] zvm.cloud_connector_url        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] zvm.reachable_timeout          = 300 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.enforce_scope      = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.policy_default_rule = default {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.connection_string     = messaging:// {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.enabled               = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.es_doc_type           = notification {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.es_scroll_size        = 10000 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.es_scroll_time        = 2m {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.filter_error_trace    = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.hmac_keys             = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.sentinel_service_name = mymaster {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.socket_timeout        = 0.1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.trace_requests        = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler.trace_sqlalchemy      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler_jaeger.process_tags   = {} {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] profiler_otlp.service_name_prefix = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] remote_debug.host              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] remote_debug.port              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.auth_section        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.auth_type           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.cafile              = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.certfile            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.collect_timing      = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.connect_retries     = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.connect_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.endpoint_id         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.endpoint_override   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.insecure            = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.keyfile             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.max_version         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.min_version         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.region_name         = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.service_name        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.service_type        = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.split_loggers       = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.status_code_retries = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.status_code_retry_delay = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.timeout             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.valid_interfaces    = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_limit.version             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_reports.file_event_handler = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] oslo_reports.log_dir           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.group  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] vif_plug_ovs_privileged.user   = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.isolate_vif         = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] os_brick.lock_path             = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.capabilities   = [21] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.group          = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.helper_command = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] privsep_osbrick.user           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.group           = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.helper_command  = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] nova_sys_admin.user            = None {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG oslo_service.service [None req-84803ac0-9659-474f-a380-0ae2a8a4ffb8 None None] ******************************************************************************** {{(pid=75326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 06 14:02:19 user nova-compute[75326]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Connecting to libvirt: qemu:///system {{(pid=75326) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9bd4da2500> {{(pid=75326) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 06 14:02:19 user nova-compute[75326]: libvirt:  error : internal error: could not initialize domain event timer
Dec 06 14:02:19 user nova-compute[75326]: WARNING nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9bd4da2500> {{(pid=75326) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Starting native event thread {{(pid=75326) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Starting green dispatch thread {{(pid=75326) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Starting connection event dispatch thread {{(pid=75326) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 06 14:02:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Connection event '1' reason 'None'
Dec 06 14:02:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 14:02:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.mount [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Initialising _HostMountState generation 0 {{(pid=75326) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 06 14:02:26 user nova-compute[75326]: INFO nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host capabilities <capabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <host>
Dec 06 14:02:26 user nova-compute[75326]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 06 14:02:26 user nova-compute[75326]:     <cpu>
Dec 06 14:02:26 user nova-compute[75326]:       <arch>x86_64</arch>
Dec 06 14:02:26 user nova-compute[75326]:       <model>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <microcode version='1070'/>
Dec 06 14:02:26 user nova-compute[75326]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='osxsave'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='invtsc'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='rsba'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature name='skip-l1dfl-vmentry'/>
Dec 06 14:02:26 user nova-compute[75326]:       <pages unit='KiB' size='4'/>
Dec 06 14:02:26 user nova-compute[75326]:       <pages unit='KiB' size='2048'/>
Dec 06 14:02:26 user nova-compute[75326]:     </cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <power_management>
Dec 06 14:02:26 user nova-compute[75326]:       <suspend_mem/>
Dec 06 14:02:26 user nova-compute[75326]:       <suspend_disk/>
Dec 06 14:02:26 user nova-compute[75326]:       <suspend_hybrid/>
Dec 06 14:02:26 user nova-compute[75326]:     </power_management>
Dec 06 14:02:26 user nova-compute[75326]:     <iommu support='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <migration_features>
Dec 06 14:02:26 user nova-compute[75326]:       <live/>
Dec 06 14:02:26 user nova-compute[75326]:       <uri_transports>
Dec 06 14:02:26 user nova-compute[75326]:         <uri_transport>tcp</uri_transport>
Dec 06 14:02:26 user nova-compute[75326]:         <uri_transport>rdma</uri_transport>
Dec 06 14:02:26 user nova-compute[75326]:       </uri_transports>
Dec 06 14:02:26 user nova-compute[75326]:     </migration_features>
Dec 06 14:02:26 user nova-compute[75326]:     <topology>
Dec 06 14:02:26 user nova-compute[75326]:       <cells num='2'>
Dec 06 14:02:26 user nova-compute[75326]:         <cell id='0'>
Dec 06 14:02:26 user nova-compute[75326]:           <memory unit='KiB'>8140616</memory>
Dec 06 14:02:26 user nova-compute[75326]:           <pages unit='KiB' size='4'>2035154</pages>
Dec 06 14:02:26 user nova-compute[75326]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 14:02:26 user nova-compute[75326]:           <distances>
Dec 06 14:02:26 user nova-compute[75326]:             <sibling id='0' value='10'/>
Dec 06 14:02:26 user nova-compute[75326]:             <sibling id='1' value='20'/>
Dec 06 14:02:26 user nova-compute[75326]:           </distances>
Dec 06 14:02:26 user nova-compute[75326]:           <cpus num='6'>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 06 14:02:26 user nova-compute[75326]:           </cpus>
Dec 06 14:02:26 user nova-compute[75326]:         </cell>
Dec 06 14:02:26 user nova-compute[75326]:         <cell id='1'>
Dec 06 14:02:26 user nova-compute[75326]:           <memory unit='KiB'>8255068</memory>
Dec 06 14:02:26 user nova-compute[75326]:           <pages unit='KiB' size='4'>2063767</pages>
Dec 06 14:02:26 user nova-compute[75326]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 14:02:26 user nova-compute[75326]:           <distances>
Dec 06 14:02:26 user nova-compute[75326]:             <sibling id='0' value='20'/>
Dec 06 14:02:26 user nova-compute[75326]:             <sibling id='1' value='10'/>
Dec 06 14:02:26 user nova-compute[75326]:           </distances>
Dec 06 14:02:26 user nova-compute[75326]:           <cpus num='6'>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 06 14:02:26 user nova-compute[75326]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 06 14:02:26 user nova-compute[75326]:           </cpus>
Dec 06 14:02:26 user nova-compute[75326]:         </cell>
Dec 06 14:02:26 user nova-compute[75326]:       </cells>
Dec 06 14:02:26 user nova-compute[75326]:     </topology>
Dec 06 14:02:26 user nova-compute[75326]:     <cache>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 06 14:02:26 user nova-compute[75326]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 06 14:02:26 user nova-compute[75326]:     </cache>
Dec 06 14:02:26 user nova-compute[75326]:     <secmodel>
Dec 06 14:02:26 user nova-compute[75326]:       <model>apparmor</model>
Dec 06 14:02:26 user nova-compute[75326]:       <doi>0</doi>
Dec 06 14:02:26 user nova-compute[75326]:     </secmodel>
Dec 06 14:02:26 user nova-compute[75326]:     <secmodel>
Dec 06 14:02:26 user nova-compute[75326]:       <model>dac</model>
Dec 06 14:02:26 user nova-compute[75326]:       <doi>0</doi>
Dec 06 14:02:26 user nova-compute[75326]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 06 14:02:26 user nova-compute[75326]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 06 14:02:26 user nova-compute[75326]:     </secmodel>
Dec 06 14:02:26 user nova-compute[75326]:   </host>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='alpha'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>clipper</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='armv6l'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>spitz</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>nuri</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>kzm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>z2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>tosa</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n810</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>terrier</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>midway</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>microbit</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>verdex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>highbank</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>akita</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>connex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>collie</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='armv7l'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>spitz</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>nuri</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>kzm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>z2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>tosa</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n810</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>terrier</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>midway</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>microbit</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>verdex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>highbank</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>akita</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>connex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>collie</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='aarch64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>spitz</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>nuri</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>kzm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>z2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>tosa</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n810</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>n800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>terrier</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>midway</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>microbit</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>verdex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>raspi3b</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>highbank</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>akita</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>connex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>collie</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <acpi default='on' toggle='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='cris'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='i686'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>isapc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>microvm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='kvm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <pae/>
Dec 06 14:02:26 user nova-compute[75326]:       <nonpae/>
Dec 06 14:02:26 user nova-compute[75326]:       <acpi default='on' toggle='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:       <apic default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='m68k'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>an5206</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>q800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>next-cube</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='microblaze'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='microblazeel'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='mips'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>malta</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='mipsel'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>malta</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='mips64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>malta</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>pica61</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>magnum</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='mips64el'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>malta</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>pica61</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>magnum</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='16'>boston</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='ppc'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mac99</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>40p</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>taihu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='ppc64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>taihu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>40p</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mac99</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='ppc64le'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>taihu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>40p</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>mac99</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='riscv32'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='8'>spike</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>opentitan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='8'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='riscv64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='8'>spike</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>shakti_c</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='8'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='s390x'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='sh4'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>shix</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>r2d</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='sh4eb'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>shix</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>r2d</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='sparc'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>SS-5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>SS-20</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>LX</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>SS-4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>SS-10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>Voyager</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='sparc64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sun4u</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>niagara</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>sun4v</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='x86_64'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>64</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='1'>isapc</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>microvm</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='kvm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <acpi default='on' toggle='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:       <apic default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='xtensa'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>sim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>kc705</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ml605</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx200</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx60</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]:   <guest>
Dec 06 14:02:26 user nova-compute[75326]:     <os_type>hvm</os_type>
Dec 06 14:02:26 user nova-compute[75326]:     <arch name='xtensaeb'>
Dec 06 14:02:26 user nova-compute[75326]:       <wordsize>32</wordsize>
Dec 06 14:02:26 user nova-compute[75326]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='4'>sim</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>kc705</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ml605</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>virt</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx200</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>lx60</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 14:02:26 user nova-compute[75326]:       <domain type='qemu'/>
Dec 06 14:02:26 user nova-compute[75326]:     </arch>
Dec 06 14:02:26 user nova-compute[75326]:     <features>
Dec 06 14:02:26 user nova-compute[75326]:       <cpuselection/>
Dec 06 14:02:26 user nova-compute[75326]:       <deviceboot/>
Dec 06 14:02:26 user nova-compute[75326]:       <disksnapshot default='on' toggle='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     </features>
Dec 06 14:02:26 user nova-compute[75326]:   </guest>
Dec 06 14:02:26 user nova-compute[75326]: </capabilities>
Dec 06 14:02:26 user nova-compute[75326]: 
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-i440fx-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>i686</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='255'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'/>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='lm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ide</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-q35-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>i686</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='288'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'/>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='lm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-q35-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>i686</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='288'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'/>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='lm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-i440fx-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>i686</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='255'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'/>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='lm'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ide</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-i440fx-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>x86_64</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='255'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>efi</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='invtsc'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='rsba'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ide</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-q35-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>x86_64</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='288'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>efi</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='invtsc'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='rsba'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-q35-jammy</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>x86_64</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='288'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>efi</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='invtsc'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='rsba'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 06 14:02:26 user nova-compute[75326]: <domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 14:02:26 user nova-compute[75326]:   <domain>kvm</domain>
Dec 06 14:02:26 user nova-compute[75326]:   <machine>pc-i440fx-6.2</machine>
Dec 06 14:02:26 user nova-compute[75326]:   <arch>x86_64</arch>
Dec 06 14:02:26 user nova-compute[75326]:   <vcpu max='255'/>
Dec 06 14:02:26 user nova-compute[75326]:   <iothreads supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:   <os supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='firmware'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>efi</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:     <loader supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>rom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pflash</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='readonly'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>yes</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='secure'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>no</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </loader>
Dec 06 14:02:26 user nova-compute[75326]:   </os>
Dec 06 14:02:26 user nova-compute[75326]:   <cpu>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-passthrough' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='hostPassthroughMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='maximum' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='maximumMigratable'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>on</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>off</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='host-model' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <vendor>Intel</vendor>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ss'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='vmx'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pcid'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='hypervisor'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arat'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='umip'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='md-clear'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='invtsc'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibpb'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='ibrs'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-stibp'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='rsba'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='erms'/>
Dec 06 14:02:26 user nova-compute[75326]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:     <mode name='custom' supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>qemu64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>qemu32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>phenom</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>pentium</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>n270</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm64</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>kvm32</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>coreduo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>core2duo</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>athlon</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Westmere</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Snowridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Skylake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>SandyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Penryn</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G5</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G4</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G3</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Opteron_G2</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Opteron_G1</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>IvyBridge</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Icelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Haswell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Rome</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-Milan</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>EPYC</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Dhyana</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cooperlake</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>Conroe</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='no'>Broadwell</model>
Dec 06 14:02:26 user nova-compute[75326]:       <model usable='yes'>486</model>
Dec 06 14:02:26 user nova-compute[75326]:     </mode>
Dec 06 14:02:26 user nova-compute[75326]:   </cpu>
Dec 06 14:02:26 user nova-compute[75326]:   <memoryBacking supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:     <enum name='sourceType'>
Dec 06 14:02:26 user nova-compute[75326]:       <value>file</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>anonymous</value>
Dec 06 14:02:26 user nova-compute[75326]:       <value>memfd</value>
Dec 06 14:02:26 user nova-compute[75326]:     </enum>
Dec 06 14:02:26 user nova-compute[75326]:   </memoryBacking>
Dec 06 14:02:26 user nova-compute[75326]:   <devices>
Dec 06 14:02:26 user nova-compute[75326]:     <disk supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='diskDevice'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>disk</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cdrom</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>floppy</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>lun</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='bus'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ide</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>fdc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sata</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </disk>
Dec 06 14:02:26 user nova-compute[75326]:     <graphics supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='type'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>sdl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vnc</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>spice</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egl-headless</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </graphics>
Dec 06 14:02:26 user nova-compute[75326]:     <video supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='modelType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>cirrus</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>vmvga</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>qxl</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>none</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>bochs</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>ramfb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </video>
Dec 06 14:02:26 user nova-compute[75326]:     <hostdev supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='mode'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>subsystem</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='startupPolicy'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>default</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>mandatory</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>requisite</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>optional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='subsysType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>usb</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>pci</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>scsi</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='capsType'/>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='pciBackend'/>
Dec 06 14:02:26 user nova-compute[75326]:     </hostdev>
Dec 06 14:02:26 user nova-compute[75326]:     <rng supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtio-non-transitional</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>random</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>egd</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>builtin</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </rng>
Dec 06 14:02:26 user nova-compute[75326]:     <filesystem supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='driverType'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>path</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>handle</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>virtiofs</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </filesystem>
Dec 06 14:02:26 user nova-compute[75326]:     <tpm supported='yes'>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='model'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-tis</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>tpm-crb</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:       <enum name='backendModel'>
Dec 06 14:02:26 user nova-compute[75326]:         <value>passthrough</value>
Dec 06 14:02:26 user nova-compute[75326]:         <value>emulator</value>
Dec 06 14:02:26 user nova-compute[75326]:       </enum>
Dec 06 14:02:26 user nova-compute[75326]:     </tpm>
Dec 06 14:02:26 user nova-compute[75326]:   </devices>
Dec 06 14:02:26 user nova-compute[75326]:   <features>
Dec 06 14:02:26 user nova-compute[75326]:     <gic supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:     <vmcoreinfo supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <genid supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backingStoreInput supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <backup supported='yes'/>
Dec 06 14:02:26 user nova-compute[75326]:     <sev supported='no'/>
Dec 06 14:02:26 user nova-compute[75326]:   </features>
Dec 06 14:02:26 user nova-compute[75326]: </domainCapabilities>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75326) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75326) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Checking secure boot support for host arch (x86_64) {{(pid=75326) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Checking secure boot support for host arch (x86_64) {{(pid=75326) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Checking secure boot support for host arch (x86_64) {{(pid=75326) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 14:02:26 user nova-compute[75326]: INFO nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Secure Boot support detected
Dec 06 14:02:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] cpu compare xml: <cpu match="exact">
Dec 06 14:02:26 user nova-compute[75326]:   <model>Nehalem</model>
Dec 06 14:02:26 user nova-compute[75326]: </cpu>
Dec 06 14:02:26 user nova-compute[75326]:  {{(pid=75326) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10025}}
Dec 06 14:02:26 user nova-compute[75326]: INFO nova.virt.node [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Generated node identity ba07be03-a218-4efb-ac98-444d17eb9220
Dec 06 14:02:26 user nova-compute[75326]: INFO nova.virt.node [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Wrote node identity ba07be03-a218-4efb-ac98-444d17eb9220 to /opt/stack/data/nova/compute_id
Dec 06 14:02:26 user nova-compute[75326]: WARNING nova.compute.manager [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Compute nodes ['ba07be03-a218-4efb-ac98-444d17eb9220'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 06 14:02:27 user nova-compute[75326]: INFO nova.compute.manager [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 06 14:02:27 user nova-compute[75326]: WARNING nova.compute.manager [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 14:02:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:02:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:02:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Hypervisor/Node resource view: name=user free_ram=10999MB free_disk=26.275436401367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:02:27 user nova-compute[75326]: WARNING nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] No compute node record for user:ba07be03-a218-4efb-ac98-444d17eb9220: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ba07be03-a218-4efb-ac98-444d17eb9220 could not be found.
Dec 06 14:02:27 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Compute node record created for user:user with uuid: ba07be03-a218-4efb-ac98-444d17eb9220
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:02:27 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] [req-221f4084-319a-40d2-a439-305ac43e5897] Created resource provider record via placement API for resource provider with UUID ba07be03-a218-4efb-ac98-444d17eb9220 and name user.
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75326) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 06 14:02:27 user nova-compute[75326]: INFO nova.virt.libvirt.host [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] kernel doesn't support AMD SEV
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Libvirt baseline CPU <cpu>
Dec 06 14:02:27 user nova-compute[75326]:   <arch>x86_64</arch>
Dec 06 14:02:27 user nova-compute[75326]:   <model>Nehalem</model>
Dec 06 14:02:27 user nova-compute[75326]:   <vendor>Intel</vendor>
Dec 06 14:02:27 user nova-compute[75326]:   <topology sockets="6" cores="1" threads="1"/>
Dec 06 14:02:27 user nova-compute[75326]: </cpu>
Dec 06 14:02:27 user nova-compute[75326]:  {{(pid=75326) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12524}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Updated inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Updating resource provider ba07be03-a218-4efb-ac98-444d17eb9220 generation from 0 to 1 during operation: update_inventory {{(pid=75326) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:02:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Updating resource provider ba07be03-a218-4efb-ac98-444d17eb9220 generation from 1 to 2 during operation: update_traits {{(pid=75326) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 14:02:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:02:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:02:28 user nova-compute[75326]: DEBUG nova.service [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Creating RPC server for service compute {{(pid=75326) start /opt/stack/nova/nova/service.py:182}}
Dec 06 14:02:28 user nova-compute[75326]: DEBUG nova.service [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] Join ServiceGroup membership for this service compute {{(pid=75326) start /opt/stack/nova/nova/service.py:199}}
Dec 06 14:02:28 user nova-compute[75326]: DEBUG nova.servicegroup.drivers.db [None req-551d9963-d5b8-4457-96f9-1ca3aedd69dc None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75326) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 06 14:02:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:02:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:03:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:03:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=10389MB free_disk=26.17934799194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:04:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:04:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=10362MB free_disk=26.244525909423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:04:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:05:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:05:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:05:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=10374MB free_disk=25.998271942138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:05:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:05:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:05:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:06:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9678MB free_disk=26.01702117919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:22 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:23 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:06:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:06:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:06:33 user nova-compute[75326]: INFO nova.compute.claims [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Claim successful on node user
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:06:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:06:33 user nova-compute[75326]: INFO nova.compute.claims [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Claim successful on node user
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:06:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Creating image(s)
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "/opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "/opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.policy [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce486cacce1b41b8b77d6c61df954d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a69d2306b2849a4b43c0c7a405b8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.virt.images [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] fe7426de-1c65-4621-9c71-22fe165b8041 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.part /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.752s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:06:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.part /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.converted" returned: 0 in 0.262s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:06:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Creating image(s)
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "/opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "/opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG nova.policy [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357791a6ab6d43ffb514b884d5af4686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ce1f74331b40d29f8515f604a49b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.117s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:34 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph05svexj/privsep.sock']
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.023s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:34 user sudo[84573]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph05svexj/privsep.sock
Dec 06 14:06:34 user sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 14:06:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Successfully created port: 1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:06:36 user sudo[84573]: pam_unix(sudo:session): session closed for user root
Dec 06 14:06:36 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Spawned new privsep daemon via rootwrap
Dec 06 14:06:36 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 14:06:36 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 14:06:36 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 06 14:06:36 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84580
Dec 06 14:06:36 user nova-compute[75326]: WARNING oslo_privsep.priv_context [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] privsep daemon already running
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:06:36 user nova-compute[75326]: INFO nova.compute.claims [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Claim successful on node user
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.270s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Successfully created port: 4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk 1073741824" returned: 0 in 0.055s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.246s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.206s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk 1073741824" returned: 0 in 0.070s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Cannot resize image /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Ensure instance console log exists: /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.206s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:06:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Creating image(s)
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.policy [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '691bec5c3db54e5d8bedc6193b976c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c49428c1da4c6592df6be7874c46f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Cannot resize image /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Ensure instance console log exists: /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk 1073741824" returned: 0 in 0.141s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:06:38 user nova-compute[75326]: INFO nova.compute.claims [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Claim successful on node user
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.201s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Cannot resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Ensure instance console log exists: /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:06:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:06:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:06:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Creating image(s)
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "/opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.policy [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ea783d27940479b9d78a93500062e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56d8164e56e499c90eca8cb27e98bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Successfully updated port: 1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquired lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.160s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk 1073741824" returned: 0 in 0.044s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-changed-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Refreshing instance network info cache due to event network-changed-1905025a-e9e6-47d2-b5bc-de95230f1f50. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] Acquiring lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.159s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Cannot resize image /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Ensure instance console log exists: /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Successfully updated port: 4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquired lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updating instance_info_cache with network_info: [{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Successfully created port: b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Releasing lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Instance network_info: |[{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] Acquired lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Refreshing network info cache for port 1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Start _get_guest_xml network_info=[{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:06:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1411425675',display_name='tempest-ServersNegativeTestJSON-server-1411425675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1411425675',id=1,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-x0lj67z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:34Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=8b318cff-3431-45bf-8712-ea2d1cd59e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b318cff-3431-45bf-8712-ea2d1cd59e3a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:06:40 user nova-compute[75326]:   <uuid>8b318cff-3431-45bf-8712-ea2d1cd59e3a</uuid>
Dec 06 14:06:40 user nova-compute[75326]:   <name>instance-00000001</name>
Dec 06 14:06:40 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:06:40 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:06:40 user nova-compute[75326]:   <metadata>
Dec 06 14:06:40 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:06:40 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:name>tempest-ServersNegativeTestJSON-server-1411425675</nova:name>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:06:40</nova:creationTime>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:06:40 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:06:40 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:owner>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:user uuid="ce486cacce1b41b8b77d6c61df954d6b">tempest-ServersNegativeTestJSON-569900546-project-member</nova:user>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:project uuid="7a69d2306b2849a4b43c0c7a405b8ffb">tempest-ServersNegativeTestJSON-569900546</nova:project>
Dec 06 14:06:40 user nova-compute[75326]:       </nova:owner>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:06:40 user nova-compute[75326]:       <nova:ports>
Dec 06 14:06:40 user nova-compute[75326]:         <nova:port uuid="1905025a-e9e6-47d2-b5bc-de95230f1f50">
Dec 06 14:06:40 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:06:40 user nova-compute[75326]:         </nova:port>
Dec 06 14:06:40 user nova-compute[75326]:       </nova:ports>
Dec 06 14:06:40 user nova-compute[75326]:     </nova:instance>
Dec 06 14:06:40 user nova-compute[75326]:   </metadata>
Dec 06 14:06:40 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:06:40 user nova-compute[75326]:     <system>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="serial">8b318cff-3431-45bf-8712-ea2d1cd59e3a</entry>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="uuid">8b318cff-3431-45bf-8712-ea2d1cd59e3a</entry>
Dec 06 14:06:40 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:06:40 user nova-compute[75326]:     </system>
Dec 06 14:06:40 user nova-compute[75326]:   </sysinfo>
Dec 06 14:06:40 user nova-compute[75326]:   <os>
Dec 06 14:06:40 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:06:40 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:06:40 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:06:40 user nova-compute[75326]:   </os>
Dec 06 14:06:40 user nova-compute[75326]:   <features>
Dec 06 14:06:40 user nova-compute[75326]:     <acpi/>
Dec 06 14:06:40 user nova-compute[75326]:     <apic/>
Dec 06 14:06:40 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:06:40 user nova-compute[75326]:   </features>
Dec 06 14:06:40 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:06:40 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:06:40 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:06:40 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:06:40 user nova-compute[75326]:   </clock>
Dec 06 14:06:40 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:06:40 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:06:40 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:06:40 user nova-compute[75326]:   </cpu>
Dec 06 14:06:40 user nova-compute[75326]:   <devices>
Dec 06 14:06:40 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:06:40 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:06:40 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk"/>
Dec 06 14:06:40 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:06:40 user nova-compute[75326]:     </disk>
Dec 06 14:06:40 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:06:40 user nova-compute[75326]:       <mac address="fa:16:3e:b6:f8:a6"/>
Dec 06 14:06:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:40 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:06:40 user nova-compute[75326]:       <target dev="tap1905025a-e9"/>
Dec 06 14:06:40 user nova-compute[75326]:     </interface>
Dec 06 14:06:40 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:06:40 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/console.log" append="off"/>
Dec 06 14:06:40 user nova-compute[75326]:     </serial>
Dec 06 14:06:40 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:06:40 user nova-compute[75326]:     <video>
Dec 06 14:06:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:40 user nova-compute[75326]:     </video>
Dec 06 14:06:40 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:06:40 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:06:40 user nova-compute[75326]:     </rng>
Dec 06 14:06:40 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:06:40 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:06:40 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:06:40 user nova-compute[75326]:     </memballoon>
Dec 06 14:06:40 user nova-compute[75326]:   </devices>
Dec 06 14:06:40 user nova-compute[75326]: </domain>
Dec 06 14:06:40 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1411425675',display_name='tempest-ServersNegativeTestJSON-server-1411425675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1411425675',id=1,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-x0lj67z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:34Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=8b318cff-3431-45bf-8712-ea2d1cd59e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:40 user nova-compute[75326]: DEBUG os_vif [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Created schema index Interface.name {{(pid=75326) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Created schema index Port.name {{(pid=75326) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Created schema index Bridge.name {{(pid=75326) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [POLLOUT] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '057de5b4-c691-5619-a68d-9d7c944f5a63', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:41 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprvcn5206/privsep.sock']
Dec 06 14:06:41 user sudo[84650]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprvcn5206/privsep.sock
Dec 06 14:06:41 user sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:06:41 user nova-compute[75326]: INFO nova.compute.claims [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Claim successful on node user
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating instance_info_cache with network_info: [{"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Releasing lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Instance network_info: |[{"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Start _get_guest_xml network_info=[{"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:06:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1422239706',display_name='tempest-DeleteServersTestJSON-server-1422239706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1422239706',id=2,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79ce1f74331b40d29f8515f604a49b8a',ramdisk_id='',reservation_id='r-1xej6vp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1808113997',owner_user_name='tempest-DeleteServersTestJSON-1808113997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:35Z,user_data=None,user_id='357791a6ab6d43ffb514b884d5af4686',uuid=0b2d7216-6f98-45c5-9721-185edf751a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converting VIF {"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b2d7216-6f98-45c5-9721-185edf751a53 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:06:41 user nova-compute[75326]:   <uuid>0b2d7216-6f98-45c5-9721-185edf751a53</uuid>
Dec 06 14:06:41 user nova-compute[75326]:   <name>instance-00000002</name>
Dec 06 14:06:41 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:06:41 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:06:41 user nova-compute[75326]:   <metadata>
Dec 06 14:06:41 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:06:41 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:name>tempest-DeleteServersTestJSON-server-1422239706</nova:name>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:06:41</nova:creationTime>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:06:41 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:06:41 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:owner>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:user uuid="357791a6ab6d43ffb514b884d5af4686">tempest-DeleteServersTestJSON-1808113997-project-member</nova:user>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:project uuid="79ce1f74331b40d29f8515f604a49b8a">tempest-DeleteServersTestJSON-1808113997</nova:project>
Dec 06 14:06:41 user nova-compute[75326]:       </nova:owner>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:06:41 user nova-compute[75326]:       <nova:ports>
Dec 06 14:06:41 user nova-compute[75326]:         <nova:port uuid="4e73bbd5-40ee-43a0-81d1-2349bcac0536">
Dec 06 14:06:41 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 14:06:41 user nova-compute[75326]:         </nova:port>
Dec 06 14:06:41 user nova-compute[75326]:       </nova:ports>
Dec 06 14:06:41 user nova-compute[75326]:     </nova:instance>
Dec 06 14:06:41 user nova-compute[75326]:   </metadata>
Dec 06 14:06:41 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:06:41 user nova-compute[75326]:     <system>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="serial">0b2d7216-6f98-45c5-9721-185edf751a53</entry>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="uuid">0b2d7216-6f98-45c5-9721-185edf751a53</entry>
Dec 06 14:06:41 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:06:41 user nova-compute[75326]:     </system>
Dec 06 14:06:41 user nova-compute[75326]:   </sysinfo>
Dec 06 14:06:41 user nova-compute[75326]:   <os>
Dec 06 14:06:41 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:06:41 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:06:41 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:06:41 user nova-compute[75326]:   </os>
Dec 06 14:06:41 user nova-compute[75326]:   <features>
Dec 06 14:06:41 user nova-compute[75326]:     <acpi/>
Dec 06 14:06:41 user nova-compute[75326]:     <apic/>
Dec 06 14:06:41 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:06:41 user nova-compute[75326]:   </features>
Dec 06 14:06:41 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:06:41 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:06:41 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:06:41 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:06:41 user nova-compute[75326]:   </clock>
Dec 06 14:06:41 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:06:41 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:06:41 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:06:41 user nova-compute[75326]:   </cpu>
Dec 06 14:06:41 user nova-compute[75326]:   <devices>
Dec 06 14:06:41 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:06:41 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:06:41 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk"/>
Dec 06 14:06:41 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:06:41 user nova-compute[75326]:     </disk>
Dec 06 14:06:41 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:06:41 user nova-compute[75326]:       <mac address="fa:16:3e:bd:b4:15"/>
Dec 06 14:06:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:41 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:06:41 user nova-compute[75326]:       <target dev="tap4e73bbd5-40"/>
Dec 06 14:06:41 user nova-compute[75326]:     </interface>
Dec 06 14:06:41 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:06:41 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/console.log" append="off"/>
Dec 06 14:06:41 user nova-compute[75326]:     </serial>
Dec 06 14:06:41 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:06:41 user nova-compute[75326]:     <video>
Dec 06 14:06:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:41 user nova-compute[75326]:     </video>
Dec 06 14:06:41 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:06:41 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:06:41 user nova-compute[75326]:     </rng>
Dec 06 14:06:41 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:06:41 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:06:41 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:06:41 user nova-compute[75326]:     </memballoon>
Dec 06 14:06:41 user nova-compute[75326]:   </devices>
Dec 06 14:06:41 user nova-compute[75326]: </domain>
Dec 06 14:06:41 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1422239706',display_name='tempest-DeleteServersTestJSON-server-1422239706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1422239706',id=2,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79ce1f74331b40d29f8515f604a49b8a',ramdisk_id='',reservation_id='r-1xej6vp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1808113997',owner_user_name='tempest-DeleteServersTestJSON-1808113997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:35Z,user_data=None,user_id='357791a6ab6d43ffb514b884d5af4686',uuid=0b2d7216-6f98-45c5-9721-185edf751a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converting VIF {"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG os_vif [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b2a6aa7-89e4-5457-a76a-c9320c7ff545', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-changed-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Refreshing instance network info cache due to event network-changed-4e73bbd5-40ee-43a0-81d1-2349bcac0536. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] Acquiring lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] Acquired lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Refreshing network info cache for port 4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:06:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:06:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:06:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Creating image(s)
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updated VIF entry in instance network info cache for port 1905025a-e9e6-47d2-b5bc-de95230f1f50. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updating instance_info_cache with network_info: [{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.policy [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'accd4da2df4141ff9e19420b42a22056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520e0b71d75a4c5cab40749ad8f40539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5accc98-dc7c-4e3a-83d2-4b91e6dcfbc3 req-7edda75a-4b75-4887-9ca9-b1c08fa46b80 service nova] Releasing lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Successfully created port: 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.157s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk 1073741824" returned: 0 in 0.062s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:42 user sudo[84650]: pam_unix(sudo:session): session closed for user root
Dec 06 14:06:42 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Spawned new privsep daemon via rootwrap
Dec 06 14:06:42 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 14:06:42 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 14:06:42 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 06 14:06:42 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84658
Dec 06 14:06:42 user nova-compute[75326]: WARNING oslo_privsep.priv_context [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] privsep daemon already running
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.165s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Cannot resize image /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e73bbd5-40, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e73bbd5-40, col_values=(('qos', UUID('b361b7ef-1fcb-45aa-a482-2324ef669d78')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e73bbd5-40, col_values=(('external_ids', {'iface-id': '4e73bbd5-40ee-43a0-81d1-2349bcac0536', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:b4:15', 'vm-uuid': '0b2d7216-6f98-45c5-9721-185edf751a53'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: INFO os_vif [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40')
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1905025a-e9, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1905025a-e9, col_values=(('qos', UUID('61778ddd-2eff-40d6-96b6-bb7924a664a4')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1905025a-e9, col_values=(('external_ids', {'iface-id': '1905025a-e9e6-47d2-b5bc-de95230f1f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:f8:a6', 'vm-uuid': '8b318cff-3431-45bf-8712-ea2d1cd59e3a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:43 user nova-compute[75326]: INFO os_vif [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9')
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updated VIF entry in instance network info cache for port 4e73bbd5-40ee-43a0-81d1-2349bcac0536. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating instance_info_cache with network_info: [{"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] No VIF found with MAC fa:16:3e:bd:b4:15, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46566635-bbe2-4962-9989-56db758d3da3 req-9d0696b8-61b2-45cf-9424-247c887dfc2d service nova] Releasing lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] No VIF found with MAC fa:16:3e:b6:f8:a6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Successfully updated port: b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-changed-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Refreshing instance network info cache due to event network-changed-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance network_info: |[{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Refreshing network info cache for port b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start _get_guest_xml network_info=[{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:06:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'pci_devices' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:06:44 user nova-compute[75326]:   <uuid>7007fec3-20a9-408b-ac10-067919ebab46</uuid>
Dec 06 14:06:44 user nova-compute[75326]:   <name>instance-00000003</name>
Dec 06 14:06:44 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:06:44 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:06:44 user nova-compute[75326]:   <metadata>
Dec 06 14:06:44 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:06:44 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeTestJSON-server-1364634591</nova:name>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:06:44</nova:creationTime>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:06:44 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:06:44 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:owner>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:user uuid="691bec5c3db54e5d8bedc6193b976c01">tempest-AttachVolumeTestJSON-653396495-project-member</nova:user>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:project uuid="83c49428c1da4c6592df6be7874c46f7">tempest-AttachVolumeTestJSON-653396495</nova:project>
Dec 06 14:06:44 user nova-compute[75326]:       </nova:owner>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:06:44 user nova-compute[75326]:       <nova:ports>
Dec 06 14:06:44 user nova-compute[75326]:         <nova:port uuid="b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1">
Dec 06 14:06:44 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:06:44 user nova-compute[75326]:         </nova:port>
Dec 06 14:06:44 user nova-compute[75326]:       </nova:ports>
Dec 06 14:06:44 user nova-compute[75326]:     </nova:instance>
Dec 06 14:06:44 user nova-compute[75326]:   </metadata>
Dec 06 14:06:44 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:06:44 user nova-compute[75326]:     <system>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="serial">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="uuid">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:06:44 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:06:44 user nova-compute[75326]:     </system>
Dec 06 14:06:44 user nova-compute[75326]:   </sysinfo>
Dec 06 14:06:44 user nova-compute[75326]:   <os>
Dec 06 14:06:44 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:06:44 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:06:44 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:06:44 user nova-compute[75326]:   </os>
Dec 06 14:06:44 user nova-compute[75326]:   <features>
Dec 06 14:06:44 user nova-compute[75326]:     <acpi/>
Dec 06 14:06:44 user nova-compute[75326]:     <apic/>
Dec 06 14:06:44 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:06:44 user nova-compute[75326]:   </features>
Dec 06 14:06:44 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:06:44 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:06:44 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:06:44 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:06:44 user nova-compute[75326]:   </clock>
Dec 06 14:06:44 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:06:44 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:06:44 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:06:44 user nova-compute[75326]:   </cpu>
Dec 06 14:06:44 user nova-compute[75326]:   <devices>
Dec 06 14:06:44 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:06:44 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:06:44 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk"/>
Dec 06 14:06:44 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:06:44 user nova-compute[75326]:     </disk>
Dec 06 14:06:44 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:06:44 user nova-compute[75326]:       <mac address="fa:16:3e:f6:6b:62"/>
Dec 06 14:06:44 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:44 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:06:44 user nova-compute[75326]:       <target dev="tapb9cd70bf-7e"/>
Dec 06 14:06:44 user nova-compute[75326]:     </interface>
Dec 06 14:06:44 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:06:44 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/console.log" append="off"/>
Dec 06 14:06:44 user nova-compute[75326]:     </serial>
Dec 06 14:06:44 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:06:44 user nova-compute[75326]:     <video>
Dec 06 14:06:44 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:44 user nova-compute[75326]:     </video>
Dec 06 14:06:44 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:06:44 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:06:44 user nova-compute[75326]:     </rng>
Dec 06 14:06:44 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:06:44 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:06:44 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:06:44 user nova-compute[75326]:     </memballoon>
Dec 06 14:06:44 user nova-compute[75326]:   </devices>
Dec 06 14:06:44 user nova-compute[75326]: </domain>
Dec 06 14:06:44 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG os_vif [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78cc2062-af30-5dd0-90ec-4c3d91517523', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9cd70bf-7e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9cd70bf-7e, col_values=(('qos', UUID('01970e7a-569a-4e12-ba04-8d39373fc33c')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9cd70bf-7e, col_values=(('external_ids', {'iface-id': 'b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6b:62', 'vm-uuid': '7007fec3-20a9-408b-ac10-067919ebab46'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:44 user nova-compute[75326]: INFO os_vif [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Successfully created port: 765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No VIF found with MAC fa:16:3e:f6:6b:62, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.neutron [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updated VIF entry in instance network info cache for port b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG nova.network.neutron [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ede77962-9ab0-4a88-ba59-4f5111554737 req-4e13baf7-fb9b-4777-ae5b-fa1059c776b0 service nova] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Successfully updated port: 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquired lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-changed-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Refreshing instance network info cache due to event network-changed-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] Acquiring lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Successfully updated port: 765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-changed-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Refreshing instance network info cache due to event network-changed-765ea7bc-2156-4815-bede-834d676d7edd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:06:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance network_info: |[{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Refreshing network info cache for port 765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start _get_guest_xml network_info=[{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:06:46 user nova-compute[75326]:   <uuid>7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</uuid>
Dec 06 14:06:46 user nova-compute[75326]:   <name>instance-00000005</name>
Dec 06 14:06:46 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:06:46 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:06:46 user nova-compute[75326]:   <metadata>
Dec 06 14:06:46 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:06:46 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherB-server-975828569</nova:name>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:06:46</nova:creationTime>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:06:46 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:06:46 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:owner>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:user uuid="accd4da2df4141ff9e19420b42a22056">tempest-ServerActionsTestOtherB-1534306586-project-member</nova:user>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:project uuid="520e0b71d75a4c5cab40749ad8f40539">tempest-ServerActionsTestOtherB-1534306586</nova:project>
Dec 06 14:06:46 user nova-compute[75326]:       </nova:owner>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:06:46 user nova-compute[75326]:       <nova:ports>
Dec 06 14:06:46 user nova-compute[75326]:         <nova:port uuid="765ea7bc-2156-4815-bede-834d676d7edd">
Dec 06 14:06:46 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:06:46 user nova-compute[75326]:         </nova:port>
Dec 06 14:06:46 user nova-compute[75326]:       </nova:ports>
Dec 06 14:06:46 user nova-compute[75326]:     </nova:instance>
Dec 06 14:06:46 user nova-compute[75326]:   </metadata>
Dec 06 14:06:46 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:06:46 user nova-compute[75326]:     <system>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="serial">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="uuid">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:06:46 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:06:46 user nova-compute[75326]:     </system>
Dec 06 14:06:46 user nova-compute[75326]:   </sysinfo>
Dec 06 14:06:46 user nova-compute[75326]:   <os>
Dec 06 14:06:46 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:06:46 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:06:46 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:06:46 user nova-compute[75326]:   </os>
Dec 06 14:06:46 user nova-compute[75326]:   <features>
Dec 06 14:06:46 user nova-compute[75326]:     <acpi/>
Dec 06 14:06:46 user nova-compute[75326]:     <apic/>
Dec 06 14:06:46 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:06:46 user nova-compute[75326]:   </features>
Dec 06 14:06:46 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:06:46 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:06:46 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:06:46 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:06:46 user nova-compute[75326]:   </clock>
Dec 06 14:06:46 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:06:46 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:06:46 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:06:46 user nova-compute[75326]:   </cpu>
Dec 06 14:06:46 user nova-compute[75326]:   <devices>
Dec 06 14:06:46 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:06:46 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:06:46 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk"/>
Dec 06 14:06:46 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:06:46 user nova-compute[75326]:     </disk>
Dec 06 14:06:46 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:06:46 user nova-compute[75326]:       <mac address="fa:16:3e:d4:cf:df"/>
Dec 06 14:06:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:46 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:06:46 user nova-compute[75326]:       <target dev="tap765ea7bc-21"/>
Dec 06 14:06:46 user nova-compute[75326]:     </interface>
Dec 06 14:06:46 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:06:46 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/console.log" append="off"/>
Dec 06 14:06:46 user nova-compute[75326]:     </serial>
Dec 06 14:06:46 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:06:46 user nova-compute[75326]:     <video>
Dec 06 14:06:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:46 user nova-compute[75326]:     </video>
Dec 06 14:06:46 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:06:46 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:06:46 user nova-compute[75326]:     </rng>
Dec 06 14:06:46 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:06:46 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:06:46 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:06:46 user nova-compute[75326]:     </memballoon>
Dec 06 14:06:46 user nova-compute[75326]:   </devices>
Dec 06 14:06:46 user nova-compute[75326]: </domain>
Dec 06 14:06:46 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG os_vif [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20df1455-e5a7-5eef-afcb-d397eca117f6', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap765ea7bc-21, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap765ea7bc-21, col_values=(('qos', UUID('50df8ec3-9ac8-4f05-970e-d36ab7ddd7be')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap765ea7bc-21, col_values=(('external_ids', {'iface-id': '765ea7bc-2156-4815-bede-834d676d7edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:df', 'vm-uuid': '7c41dda6-b0b1-44e3-8696-e085ff4f2bbf'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: INFO os_vif [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No VIF found with MAC fa:16:3e:d4:cf:df, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Releasing lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Instance network_info: |[{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] Acquired lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Refreshing network info cache for port 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Start _get_guest_xml network_info=[{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:06:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:06:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518219702',display_name='tempest-AttachVolumeNegativeTest-server-518219702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518219702',id=4,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmyHDDF9BPJRvqatQDLToHPzMljsbehbhhYz72EK2yyfEZr/2Kker7Pn4mSp8m2XJQGM96gx1GGKWUHN1hiIkIq9p2qg5Llu1B855P7qQ23x2aKs2rKsenx/2OA861jpg==',key_name='tempest-keypair-1190683522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-rx3lmj2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=be7c9178-71ea-4b1e-a926-e890d5efd218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'pci_devices' on Instance uuid be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:06:47 user nova-compute[75326]:   <uuid>be7c9178-71ea-4b1e-a926-e890d5efd218</uuid>
Dec 06 14:06:47 user nova-compute[75326]:   <name>instance-00000004</name>
Dec 06 14:06:47 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:06:47 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:06:47 user nova-compute[75326]:   <metadata>
Dec 06 14:06:47 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:06:47 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeNegativeTest-server-518219702</nova:name>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:06:46</nova:creationTime>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:06:47 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:06:47 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:owner>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:user uuid="6ea783d27940479b9d78a93500062e8e">tempest-AttachVolumeNegativeTest-1014509330-project-member</nova:user>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:project uuid="f56d8164e56e499c90eca8cb27e98bf9">tempest-AttachVolumeNegativeTest-1014509330</nova:project>
Dec 06 14:06:47 user nova-compute[75326]:       </nova:owner>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:06:47 user nova-compute[75326]:       <nova:ports>
Dec 06 14:06:47 user nova-compute[75326]:         <nova:port uuid="11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381">
Dec 06 14:06:47 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:06:47 user nova-compute[75326]:         </nova:port>
Dec 06 14:06:47 user nova-compute[75326]:       </nova:ports>
Dec 06 14:06:47 user nova-compute[75326]:     </nova:instance>
Dec 06 14:06:47 user nova-compute[75326]:   </metadata>
Dec 06 14:06:47 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:06:47 user nova-compute[75326]:     <system>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="serial">be7c9178-71ea-4b1e-a926-e890d5efd218</entry>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="uuid">be7c9178-71ea-4b1e-a926-e890d5efd218</entry>
Dec 06 14:06:47 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:06:47 user nova-compute[75326]:     </system>
Dec 06 14:06:47 user nova-compute[75326]:   </sysinfo>
Dec 06 14:06:47 user nova-compute[75326]:   <os>
Dec 06 14:06:47 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:06:47 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:06:47 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:06:47 user nova-compute[75326]:   </os>
Dec 06 14:06:47 user nova-compute[75326]:   <features>
Dec 06 14:06:47 user nova-compute[75326]:     <acpi/>
Dec 06 14:06:47 user nova-compute[75326]:     <apic/>
Dec 06 14:06:47 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:06:47 user nova-compute[75326]:   </features>
Dec 06 14:06:47 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:06:47 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:06:47 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:06:47 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:06:47 user nova-compute[75326]:   </clock>
Dec 06 14:06:47 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:06:47 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:06:47 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:06:47 user nova-compute[75326]:   </cpu>
Dec 06 14:06:47 user nova-compute[75326]:   <devices>
Dec 06 14:06:47 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:06:47 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:06:47 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk"/>
Dec 06 14:06:47 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:06:47 user nova-compute[75326]:     </disk>
Dec 06 14:06:47 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:06:47 user nova-compute[75326]:       <mac address="fa:16:3e:37:b8:45"/>
Dec 06 14:06:47 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:47 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:06:47 user nova-compute[75326]:       <target dev="tap11ba6a1b-7e"/>
Dec 06 14:06:47 user nova-compute[75326]:     </interface>
Dec 06 14:06:47 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:06:47 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/console.log" append="off"/>
Dec 06 14:06:47 user nova-compute[75326]:     </serial>
Dec 06 14:06:47 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:06:47 user nova-compute[75326]:     <video>
Dec 06 14:06:47 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:06:47 user nova-compute[75326]:     </video>
Dec 06 14:06:47 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:06:47 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:06:47 user nova-compute[75326]:     </rng>
Dec 06 14:06:47 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:06:47 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:06:47 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:06:47 user nova-compute[75326]:     </memballoon>
Dec 06 14:06:47 user nova-compute[75326]:   </devices>
Dec 06 14:06:47 user nova-compute[75326]: </domain>
Dec 06 14:06:47 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518219702',display_name='tempest-AttachVolumeNegativeTest-server-518219702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518219702',id=4,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmyHDDF9BPJRvqatQDLToHPzMljsbehbhhYz72EK2yyfEZr/2Kker7Pn4mSp8m2XJQGM96gx1GGKWUHN1hiIkIq9p2qg5Llu1B855P7qQ23x2aKs2rKsenx/2OA861jpg==',key_name='tempest-keypair-1190683522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-rx3lmj2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=be7c9178-71ea-4b1e-a926-e890d5efd218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG os_vif [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4b3cd7d-62e0-5c1a-b79b-f7091e51fcc2', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11ba6a1b-7e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11ba6a1b-7e, col_values=(('qos', UUID('94ed71be-7dbc-4b41-a86c-3350d0090a04')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11ba6a1b-7e, col_values=(('external_ids', {'iface-id': '11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:b8:45', 'vm-uuid': 'be7c9178-71ea-4b1e-a926-e890d5efd218'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: INFO os_vif [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e')
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:37:b8:45, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updated VIF entry in instance network info cache for port 765ea7bc-2156-4815-bede-834d676d7edd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-38643572-78ef-41cf-8ff0-58d57dd5758b req-1747614d-b595-4a0c-81a7-a5184371488d service nova] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updated VIF entry in instance network info cache for port 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:06:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:06:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af054ddd-001e-44fa-a423-39aa0dbeb1e8 req-ce56b1e2-3189-4c8b-90b9-eaa6aaeb130d service nova] Releasing lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:06:52 user nova-compute[75326]: WARNING nova.compute.manager [req-94c2fc23-392d-43c1-ace4-827de7e1b5cf req-4864c509-d783-43a3-b7dd-29201a85fcab service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state building and task_state spawning.
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Instance spawned successfully.
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:52 user nova-compute[75326]: INFO nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Took 19.02 seconds to spawn the instance on the hypervisor.
Dec 06 14:06:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:06:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.compute.manager [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Took 20.58 seconds to build instance.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c9e3984-b60c-40f3-9ba2-71b8e30a2510 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.868s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Instance spawned successfully.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance spawned successfully.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance spawned successfully.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Took 15.96 seconds to spawn the instance on the hypervisor.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Took 18.85 seconds to spawn the instance on the hypervisor.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Instance spawned successfully.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:06:53 user nova-compute[75326]: INFO nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Took 11.78 seconds to spawn the instance on the hypervisor.
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:06:54 user nova-compute[75326]: INFO nova.compute.manager [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Took 17.18 seconds to build instance.
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f30173b-06a5-43db-897f-4052ff77bbb7 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.361s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:54 user nova-compute[75326]: INFO nova.compute.manager [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Took 12.81 seconds to build instance.
Dec 06 14:06:54 user nova-compute[75326]: INFO nova.compute.manager [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Took 20.38 seconds to build instance.
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44f7348d-7213-44bd-a0c3-d6be382c9a67 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.990s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f44d1449-c86c-4707-8350-f2cac5001e44 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.691s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:54 user nova-compute[75326]: INFO nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Took 15.15 seconds to spawn the instance on the hypervisor.
Dec 06 14:06:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:54 user nova-compute[75326]: INFO nova.compute.manager [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Took 16.09 seconds to build instance.
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a0bba808-3a7b-4404-8188-fc63eb89e354 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.439s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:06:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:06:54 user nova-compute[75326]: WARNING nova.compute.manager [req-db7c8ba5-332b-4c8b-affc-3edcb7559953 req-0bb6099d-02b0-4b02-ae47-10ddef1ac1c4 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state active and task_state None.
Dec 06 14:06:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:06:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:07:01 user nova-compute[75326]: INFO nova.compute.claims [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Claim successful on node user
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:07:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.policy [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2fac47e105a4ce8af79f6d802ebb59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d51e81a50c4494a2ef06459b6ab745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:07:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Creating image(s)
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "/opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "/opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "/opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.299s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.343s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk 1073741824" returned: 0 in 0.068s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.419s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.290s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Cannot resize image /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Ensure instance console log exists: /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.010s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Successfully created port: 5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Successfully updated port: 5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquired lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-changed-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Refreshing instance network info cache due to event network-changed-5510da4c-bf2a-4782-b0ab-7aff4db2e74d. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] Acquiring lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:07:05 user nova-compute[75326]: INFO nova.compute.claims [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Claim successful on node user
Dec 06 14:07:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating instance_info_cache with network_info: [{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Releasing lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Instance network_info: |[{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] Acquired lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Refreshing network info cache for port 5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Start _get_guest_xml network_info=[{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:06 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:06 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1022359840',display_name='tempest-VolumesAdminNegativeTest-server-1022359840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1022359840',id=6,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVkvG8YbDKG75LyWs3RX7KfYTdRds7DESXJ9naM6pTMkCz4VguPtg+amPp/2HHJJrzYshg+bTeABkRt8AqWYij2LieMakkCeto6KPEiRthZRL6cJV/nJBXi/W0km5owhw==',key_name='tempest-keypair-1641125632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-ujljwatl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=b475687e-52b7-4cff-bc22-dbb8b732d1c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'pci_devices' on Instance uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:07:06 user nova-compute[75326]:   <uuid>b475687e-52b7-4cff-bc22-dbb8b732d1c6</uuid>
Dec 06 14:07:06 user nova-compute[75326]:   <name>instance-00000006</name>
Dec 06 14:07:06 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:07:06 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:07:06 user nova-compute[75326]:   <metadata>
Dec 06 14:07:06 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:07:06 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1022359840</nova:name>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:07:06</nova:creationTime>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:07:06 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:07:06 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:owner>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:user uuid="c2fac47e105a4ce8af79f6d802ebb59e">tempest-VolumesAdminNegativeTest-782371247-project-member</nova:user>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:project uuid="72d51e81a50c4494a2ef06459b6ab745">tempest-VolumesAdminNegativeTest-782371247</nova:project>
Dec 06 14:07:06 user nova-compute[75326]:       </nova:owner>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:07:06 user nova-compute[75326]:       <nova:ports>
Dec 06 14:07:06 user nova-compute[75326]:         <nova:port uuid="5510da4c-bf2a-4782-b0ab-7aff4db2e74d">
Dec 06 14:07:06 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 14:07:06 user nova-compute[75326]:         </nova:port>
Dec 06 14:07:06 user nova-compute[75326]:       </nova:ports>
Dec 06 14:07:06 user nova-compute[75326]:     </nova:instance>
Dec 06 14:07:06 user nova-compute[75326]:   </metadata>
Dec 06 14:07:06 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:07:06 user nova-compute[75326]:     <system>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="serial">b475687e-52b7-4cff-bc22-dbb8b732d1c6</entry>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="uuid">b475687e-52b7-4cff-bc22-dbb8b732d1c6</entry>
Dec 06 14:07:06 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:07:06 user nova-compute[75326]:     </system>
Dec 06 14:07:06 user nova-compute[75326]:   </sysinfo>
Dec 06 14:07:06 user nova-compute[75326]:   <os>
Dec 06 14:07:06 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:07:06 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:07:06 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:07:06 user nova-compute[75326]:   </os>
Dec 06 14:07:06 user nova-compute[75326]:   <features>
Dec 06 14:07:06 user nova-compute[75326]:     <acpi/>
Dec 06 14:07:06 user nova-compute[75326]:     <apic/>
Dec 06 14:07:06 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:07:06 user nova-compute[75326]:   </features>
Dec 06 14:07:06 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:07:06 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:07:06 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:07:06 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:07:06 user nova-compute[75326]:   </clock>
Dec 06 14:07:06 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:07:06 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:07:06 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:07:06 user nova-compute[75326]:   </cpu>
Dec 06 14:07:06 user nova-compute[75326]:   <devices>
Dec 06 14:07:06 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:07:06 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:07:06 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk"/>
Dec 06 14:07:06 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:07:06 user nova-compute[75326]:     </disk>
Dec 06 14:07:06 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:07:06 user nova-compute[75326]:       <mac address="fa:16:3e:d9:25:d0"/>
Dec 06 14:07:06 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:06 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:07:06 user nova-compute[75326]:       <target dev="tap5510da4c-bf"/>
Dec 06 14:07:06 user nova-compute[75326]:     </interface>
Dec 06 14:07:06 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:07:06 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/console.log" append="off"/>
Dec 06 14:07:06 user nova-compute[75326]:     </serial>
Dec 06 14:07:06 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:07:06 user nova-compute[75326]:     <video>
Dec 06 14:07:06 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:06 user nova-compute[75326]:     </video>
Dec 06 14:07:06 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:07:06 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:07:06 user nova-compute[75326]:     </rng>
Dec 06 14:07:06 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:07:06 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:07:06 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:07:06 user nova-compute[75326]:     </memballoon>
Dec 06 14:07:06 user nova-compute[75326]:   </devices>
Dec 06 14:07:06 user nova-compute[75326]: </domain>
Dec 06 14:07:06 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1022359840',display_name='tempest-VolumesAdminNegativeTest-server-1022359840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1022359840',id=6,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVkvG8YbDKG75LyWs3RX7KfYTdRds7DESXJ9naM6pTMkCz4VguPtg+amPp/2HHJJrzYshg+bTeABkRt8AqWYij2LieMakkCeto6KPEiRthZRL6cJV/nJBXi/W0km5owhw==',key_name='tempest-keypair-1641125632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-ujljwatl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=b475687e-52b7-4cff-bc22-dbb8b732d1c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG os_vif [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14109468-4896-5813-b675-ba06dccaf488', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5510da4c-bf, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5510da4c-bf, col_values=(('qos', UUID('20cf075c-1da5-4e44-808a-ab1099a639d4')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5510da4c-bf, col_values=(('external_ids', {'iface-id': '5510da4c-bf2a-4782-b0ab-7aff4db2e74d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:25:d0', 'vm-uuid': 'b475687e-52b7-4cff-bc22-dbb8b732d1c6'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:06 user nova-compute[75326]: INFO os_vif [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf')
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No VIF found with MAC fa:16:3e:d9:25:d0, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:07:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.policy [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a403f032e48e4862b04d4fdb8680b40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0cd38d55641fb8af4654ad2a95c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:07:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Creating image(s)
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.359s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updated VIF entry in instance network info cache for port 5510da4c-bf2a-4782-b0ab-7aff4db2e74d. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating instance_info_cache with network_info: [{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8b5cee24-7396-4334-952d-685099cded7f req-5251ec6b-c2e0-4394-9cd8-282a6297dad6 service nova] Releasing lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.327s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk 1073741824" returned: 0 in 0.104s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.441s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.325s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.014s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:07:08 user nova-compute[75326]: INFO nova.compute.claims [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Claim successful on node user
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Cannot resize image /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Ensure instance console log exists: /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Successfully created port: f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.125s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:07:09 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:07:09 user nova-compute[75326]: DEBUG nova.policy [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dae5bf486abc4c4ca58c2bf7f602d3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bce7330aa3e4bce8640074c19670f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:07:10 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Creating image(s)
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Successfully created port: 5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.part --force-share --output=json" returned: 0 in 0.393s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.virt.images [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] b5d02b36-faaf-4b99-bbe1-90d4205d44b0 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.part /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:07:11 user nova-compute[75326]: INFO nova.compute.claims [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Claim successful on node user
Dec 06 14:07:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.part /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.converted" returned: 0 in 0.248s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Successfully updated port: f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-changed-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing instance network info cache due to event network-changed-f686132b-b2e9-4590-a52a-1e0e6e1bf504. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.network.neutron [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing network info cache for port f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7.converted --force-share --output=json" returned: 0 in 0.303s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.707s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:11 user nova-compute[75326]: DEBUG nova.network.neutron [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json" returned: 0 in 0.259s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:07:12 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Instance spawned successfully.
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json" returned: 0 in 0.342s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7,backing_fmt=raw /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:12 user nova-compute[75326]: INFO nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Took 9.83 seconds to spawn the instance on the hypervisor.
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Successfully updated port: 5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-changed-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Refreshing instance network info cache due to event network-changed-5a557284-877d-4b20-9636-c231962e9aaa. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] Acquiring lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] Acquired lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Refreshing network info cache for port 5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7,backing_fmt=raw /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk 1073741824" returned: 0 in 0.145s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "f7d3bbf6181bf303504a2c8204c0356fed85b6f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.496s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 --force-share --output=json" returned: 0 in 0.265s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f198858b-187b-4555-a110-d12e6f174c1f req-b8374be0-8487-41a6-8489-6c27bac557bf service nova] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:07:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.830s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:13 user nova-compute[75326]: INFO nova.compute.manager [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Took 11.63 seconds to build instance.
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Cannot resize image /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Ensure instance console log exists: /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5fb564a4-156c-43bd-a911-dc7a0cfec400 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.901s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.policy [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13b192e6cb6b4dd68e3f486c54b7914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77600d303d4443cda73f52c12a549613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.network.neutron [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:07:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Creating image(s)
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "/opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "/opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "/opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.028s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a8277c77-f58e-4944-8598-03b228e0102b req-6e2561e1-65b9-452c-a888-cdf263dff2d3 service nova] Releasing lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquired lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.309s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk 1073741824" returned: 0 in 0.099s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance network_info: |[{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Start _get_guest_xml network_info=[{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:07:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'pci_devices' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:07:14 user nova-compute[75326]:   <uuid>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</uuid>
Dec 06 14:07:14 user nova-compute[75326]:   <name>instance-00000007</name>
Dec 06 14:07:14 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:07:14 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:07:14 user nova-compute[75326]:   <metadata>
Dec 06 14:07:14 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:07:14 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:07:14</nova:creationTime>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:07:14 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:owner>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:owner>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:ports>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:07:14 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:07:14 user nova-compute[75326]:         </nova:port>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:ports>
Dec 06 14:07:14 user nova-compute[75326]:     </nova:instance>
Dec 06 14:07:14 user nova-compute[75326]:   </metadata>
Dec 06 14:07:14 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:07:14 user nova-compute[75326]:     <system>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="serial">03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="uuid">03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:07:14 user nova-compute[75326]:     </system>
Dec 06 14:07:14 user nova-compute[75326]:   </sysinfo>
Dec 06 14:07:14 user nova-compute[75326]:   <os>
Dec 06 14:07:14 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:07:14 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:07:14 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:07:14 user nova-compute[75326]:   </os>
Dec 06 14:07:14 user nova-compute[75326]:   <features>
Dec 06 14:07:14 user nova-compute[75326]:     <acpi/>
Dec 06 14:07:14 user nova-compute[75326]:     <apic/>
Dec 06 14:07:14 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:07:14 user nova-compute[75326]:   </features>
Dec 06 14:07:14 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:07:14 user nova-compute[75326]:   </clock>
Dec 06 14:07:14 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:07:14 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:07:14 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:07:14 user nova-compute[75326]:   </cpu>
Dec 06 14:07:14 user nova-compute[75326]:   <devices>
Dec 06 14:07:14 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:07:14 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:07:14 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:07:14 user nova-compute[75326]:     </disk>
Dec 06 14:07:14 user nova-compute[75326]:     <disk type="file" device="cdrom">
Dec 06 14:07:14 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 14:07:14 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="hda" bus="ide"/>
Dec 06 14:07:14 user nova-compute[75326]:     </disk>
Dec 06 14:07:14 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:07:14 user nova-compute[75326]:       <mac address="fa:16:3e:b8:51:61"/>
Dec 06 14:07:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:14 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="tapf686132b-b2"/>
Dec 06 14:07:14 user nova-compute[75326]:     </interface>
Dec 06 14:07:14 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:07:14 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log" append="off"/>
Dec 06 14:07:14 user nova-compute[75326]:     </serial>
Dec 06 14:07:14 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:07:14 user nova-compute[75326]:     <video>
Dec 06 14:07:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:14 user nova-compute[75326]:     </video>
Dec 06 14:07:14 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:07:14 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:07:14 user nova-compute[75326]:     </rng>
Dec 06 14:07:14 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:07:14 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:07:14 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:07:14 user nova-compute[75326]:     </memballoon>
Dec 06 14:07:14 user nova-compute[75326]:   </devices>
Dec 06 14:07:14 user nova-compute[75326]: </domain>
Dec 06 14:07:14 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG os_vif [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3a3e7c-80b2-5293-bd47-2795231d0f98', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updating instance_info_cache with network_info: [{"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf686132b-b2, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf686132b-b2, col_values=(('qos', UUID('f2fb6a51-4e38-4e3b-86d0-76a6aa0affe2')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf686132b-b2, col_values=(('external_ids', {'iface-id': 'f686132b-b2e9-4590-a52a-1e0e6e1bf504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:51:61', 'vm-uuid': '03196bf5-7f24-4a32-b7ce-e3b0560ee0bb'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: INFO os_vif [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2')
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Releasing lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance network_info: |[{"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Start _get_guest_xml network_info=[{"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:06:57Z,direct_url=<?>,disk_format='qcow2',id=b5d02b36-faaf-4b99-bbe1-90d4205d44b0,min_disk=0,min_ram=0,name='',owner='a84680d0467540ce9afbed44c422c7e2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:07:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'b5d02b36-faaf-4b99-bbe1-90d4205d44b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.255s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:06:57Z,direct_url=<?>,disk_format='qcow2',id=b5d02b36-faaf-4b99-bbe1-90d4205d44b0,min_disk=0,min_ram=0,name='',owner='a84680d0467540ce9afbed44c422c7e2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:07:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-469026386',display_name='tempest-AttachSCSIVolumeTestJSON-server-469026386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-469026386',id=8,image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrFGVnXAMiY84wdPap15hf3O29EGjJ+WRoG3vqHiMlFt/OUc2K8Ic6QjUmaZn3BaL8T4XbKRPBRVps2NGhw3OSPMbsB6gXoimxR2f6cY81Fj58w1O2S9HlaoLhcDi1y7g==',key_name='tempest-keypair-1131004893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bce7330aa3e4bce8640074c19670f81',ramdisk_id='',reservation_id='r-ro3wgh7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269260849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269260849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dae5bf486abc4c4ca58c2bf7f602d3dc',uuid=ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converting VIF {"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lazy-loading 'pci_devices' on Instance uuid ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:07:14 user nova-compute[75326]:   <uuid>ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d</uuid>
Dec 06 14:07:14 user nova-compute[75326]:   <name>instance-00000008</name>
Dec 06 14:07:14 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:07:14 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:07:14 user nova-compute[75326]:   <metadata>
Dec 06 14:07:14 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:07:14 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-469026386</nova:name>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:07:14</nova:creationTime>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:07:14 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:owner>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:user uuid="dae5bf486abc4c4ca58c2bf7f602d3dc">tempest-AttachSCSIVolumeTestJSON-1269260849-project-member</nova:user>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:project uuid="7bce7330aa3e4bce8640074c19670f81">tempest-AttachSCSIVolumeTestJSON-1269260849</nova:project>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:owner>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:root type="image" uuid="b5d02b36-faaf-4b99-bbe1-90d4205d44b0"/>
Dec 06 14:07:14 user nova-compute[75326]:       <nova:ports>
Dec 06 14:07:14 user nova-compute[75326]:         <nova:port uuid="5a557284-877d-4b20-9636-c231962e9aaa">
Dec 06 14:07:14 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 14:07:14 user nova-compute[75326]:         </nova:port>
Dec 06 14:07:14 user nova-compute[75326]:       </nova:ports>
Dec 06 14:07:14 user nova-compute[75326]:     </nova:instance>
Dec 06 14:07:14 user nova-compute[75326]:   </metadata>
Dec 06 14:07:14 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:07:14 user nova-compute[75326]:     <system>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="serial">ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="uuid">ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d</entry>
Dec 06 14:07:14 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:07:14 user nova-compute[75326]:     </system>
Dec 06 14:07:14 user nova-compute[75326]:   </sysinfo>
Dec 06 14:07:14 user nova-compute[75326]:   <os>
Dec 06 14:07:14 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:07:14 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:07:14 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:07:14 user nova-compute[75326]:   </os>
Dec 06 14:07:14 user nova-compute[75326]:   <features>
Dec 06 14:07:14 user nova-compute[75326]:     <acpi/>
Dec 06 14:07:14 user nova-compute[75326]:     <apic/>
Dec 06 14:07:14 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:07:14 user nova-compute[75326]:   </features>
Dec 06 14:07:14 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:07:14 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:07:14 user nova-compute[75326]:   </clock>
Dec 06 14:07:14 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:07:14 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:07:14 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:07:14 user nova-compute[75326]:   </cpu>
Dec 06 14:07:14 user nova-compute[75326]:   <devices>
Dec 06 14:07:14 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:07:14 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:07:14 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="sda" bus="scsi"/>
Dec 06 14:07:14 user nova-compute[75326]:       <address type="drive" controller="0" unit="0"/>
Dec 06 14:07:14 user nova-compute[75326]:     </disk>
Dec 06 14:07:14 user nova-compute[75326]:     <disk type="file" device="cdrom">
Dec 06 14:07:14 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 14:07:14 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.config"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="sdb" bus="scsi"/>
Dec 06 14:07:14 user nova-compute[75326]:       <address type="drive" controller="0" unit="1"/>
Dec 06 14:07:14 user nova-compute[75326]:     </disk>
Dec 06 14:07:14 user nova-compute[75326]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 06 14:07:14 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:07:14 user nova-compute[75326]:       <mac address="fa:16:3e:22:29:8a"/>
Dec 06 14:07:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:14 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:07:14 user nova-compute[75326]:       <target dev="tap5a557284-87"/>
Dec 06 14:07:14 user nova-compute[75326]:     </interface>
Dec 06 14:07:14 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:07:14 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/console.log" append="off"/>
Dec 06 14:07:14 user nova-compute[75326]:     </serial>
Dec 06 14:07:14 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:07:14 user nova-compute[75326]:     <video>
Dec 06 14:07:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:14 user nova-compute[75326]:     </video>
Dec 06 14:07:14 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:07:14 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:07:14 user nova-compute[75326]:     </rng>
Dec 06 14:07:14 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:07:14 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:07:14 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:07:14 user nova-compute[75326]:     </memballoon>
Dec 06 14:07:14 user nova-compute[75326]:   </devices>
Dec 06 14:07:14 user nova-compute[75326]: </domain>
Dec 06 14:07:14 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-469026386',display_name='tempest-AttachSCSIVolumeTestJSON-server-469026386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-469026386',id=8,image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrFGVnXAMiY84wdPap15hf3O29EGjJ+WRoG3vqHiMlFt/OUc2K8Ic6QjUmaZn3BaL8T4XbKRPBRVps2NGhw3OSPMbsB6gXoimxR2f6cY81Fj58w1O2S9HlaoLhcDi1y7g==',key_name='tempest-keypair-1131004893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bce7330aa3e4bce8640074c19670f81',ramdisk_id='',reservation_id='r-ro3wgh7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269260849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269260849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dae5bf486abc4c4ca58c2bf7f602d3dc',uuid=ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converting VIF {"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG os_vif [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bbea0b4-c89a-5f1f-a048-9953b59791af', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a557284-87, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a557284-87, col_values=(('qos', UUID('4a1b4818-c47f-4137-973f-5450cb8e92aa')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a557284-87, col_values=(('external_ids', {'iface-id': '5a557284-877d-4b20-9636-c231962e9aaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:29:8a', 'vm-uuid': 'ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name hda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No VIF found with MAC fa:16:3e:b8:51:61, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:07:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Using config drive
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Cannot resize image /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Ensure instance console log exists: /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:14 user nova-compute[75326]: INFO os_vif [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87')
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No BDM found with device name sda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No VIF found with MAC fa:16:3e:22:29:8a, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:07:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Using config drive
Dec 06 14:07:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Successfully created port: 3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Creating config drive at /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1q34prue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1q34prue" returned: 0 in 0.064s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Successfully updated port: 3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquired lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-changed-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Refreshing instance network info cache due to event network-changed-3bb531cd-ccf4-44a1-8f23-53474ef96150. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] Acquiring lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Creating config drive at /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.config
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcpw5xozz {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcpw5xozz" returned: 0 in 0.056s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updating instance_info_cache with network_info: [{"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Releasing lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Instance network_info: |[{"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] Acquired lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Refreshing network info cache for port 3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Start _get_guest_xml network_info=[{"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:07:16 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:16 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-964053311',display_name='tempest-VolumesAssistedSnapshotsTest-server-964053311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-964053311',id=9,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPmcxPUa0a6oHrnbidJkqqhjeBOmgumRsbFcNoM4a9L4JddThhzSs2hQ7dwswTk8VDagtFgTse8gXhhdVwgi1PXynyySVWBDa5PnP/EyUPSfL+JiyjdApf51n9xqgb6Kw==',key_name='tempest-keypair-1559932994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77600d303d4443cda73f52c12a549613',ramdisk_id='',reservation_id='r-bt1nmvfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-886439876',owner_user_name='tempest-VolumesAssistedSnapshotsTest-886439876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b192e6cb6b4dd68e3f486c54b7914d',uuid=872abe6f-2e97-4ac4-98c3-fb52778e33ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converting VIF {"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lazy-loading 'pci_devices' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:07:16 user nova-compute[75326]:   <uuid>872abe6f-2e97-4ac4-98c3-fb52778e33ce</uuid>
Dec 06 14:07:16 user nova-compute[75326]:   <name>instance-00000009</name>
Dec 06 14:07:16 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:07:16 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:07:16 user nova-compute[75326]:   <metadata>
Dec 06 14:07:16 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:07:16 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-964053311</nova:name>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:07:16</nova:creationTime>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:07:16 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:07:16 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:owner>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:user uuid="13b192e6cb6b4dd68e3f486c54b7914d">tempest-VolumesAssistedSnapshotsTest-886439876-project-member</nova:user>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:project uuid="77600d303d4443cda73f52c12a549613">tempest-VolumesAssistedSnapshotsTest-886439876</nova:project>
Dec 06 14:07:16 user nova-compute[75326]:       </nova:owner>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:07:16 user nova-compute[75326]:       <nova:ports>
Dec 06 14:07:16 user nova-compute[75326]:         <nova:port uuid="3bb531cd-ccf4-44a1-8f23-53474ef96150">
Dec 06 14:07:16 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:07:16 user nova-compute[75326]:         </nova:port>
Dec 06 14:07:16 user nova-compute[75326]:       </nova:ports>
Dec 06 14:07:16 user nova-compute[75326]:     </nova:instance>
Dec 06 14:07:16 user nova-compute[75326]:   </metadata>
Dec 06 14:07:16 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:07:16 user nova-compute[75326]:     <system>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="serial">872abe6f-2e97-4ac4-98c3-fb52778e33ce</entry>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="uuid">872abe6f-2e97-4ac4-98c3-fb52778e33ce</entry>
Dec 06 14:07:16 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:07:16 user nova-compute[75326]:     </system>
Dec 06 14:07:16 user nova-compute[75326]:   </sysinfo>
Dec 06 14:07:16 user nova-compute[75326]:   <os>
Dec 06 14:07:16 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:07:16 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:07:16 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:07:16 user nova-compute[75326]:   </os>
Dec 06 14:07:16 user nova-compute[75326]:   <features>
Dec 06 14:07:16 user nova-compute[75326]:     <acpi/>
Dec 06 14:07:16 user nova-compute[75326]:     <apic/>
Dec 06 14:07:16 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:07:16 user nova-compute[75326]:   </features>
Dec 06 14:07:16 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:07:16 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:07:16 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:07:16 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:07:16 user nova-compute[75326]:   </clock>
Dec 06 14:07:16 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:07:16 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:07:16 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:07:16 user nova-compute[75326]:   </cpu>
Dec 06 14:07:16 user nova-compute[75326]:   <devices>
Dec 06 14:07:16 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:07:16 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:07:16 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk"/>
Dec 06 14:07:16 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:07:16 user nova-compute[75326]:     </disk>
Dec 06 14:07:16 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:07:16 user nova-compute[75326]:       <mac address="fa:16:3e:78:d6:c2"/>
Dec 06 14:07:16 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:16 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:07:16 user nova-compute[75326]:       <target dev="tap3bb531cd-cc"/>
Dec 06 14:07:16 user nova-compute[75326]:     </interface>
Dec 06 14:07:16 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:07:16 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/console.log" append="off"/>
Dec 06 14:07:16 user nova-compute[75326]:     </serial>
Dec 06 14:07:16 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:07:16 user nova-compute[75326]:     <video>
Dec 06 14:07:16 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:07:16 user nova-compute[75326]:     </video>
Dec 06 14:07:16 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:07:16 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:07:16 user nova-compute[75326]:     </rng>
Dec 06 14:07:16 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:07:16 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:07:16 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:07:16 user nova-compute[75326]:     </memballoon>
Dec 06 14:07:16 user nova-compute[75326]:   </devices>
Dec 06 14:07:16 user nova-compute[75326]: </domain>
Dec 06 14:07:16 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-964053311',display_name='tempest-VolumesAssistedSnapshotsTest-server-964053311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-964053311',id=9,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPmcxPUa0a6oHrnbidJkqqhjeBOmgumRsbFcNoM4a9L4JddThhzSs2hQ7dwswTk8VDagtFgTse8gXhhdVwgi1PXynyySVWBDa5PnP/EyUPSfL+JiyjdApf51n9xqgb6Kw==',key_name='tempest-keypair-1559932994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77600d303d4443cda73f52c12a549613',ramdisk_id='',reservation_id='r-bt1nmvfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-886439876',owner_user_name='tempest-VolumesAssistedSnapshotsTest-886439876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b192e6cb6b4dd68e3f486c54b7914d',uuid=872abe6f-2e97-4ac4-98c3-fb52778e33ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converting VIF {"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG os_vif [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2805e3e8-043a-57cc-8126-e12eba7feede', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bb531cd-cc, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bb531cd-cc, col_values=(('qos', UUID('8067f1b9-8378-4665-b5a8-d69bf0538514')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bb531cd-cc, col_values=(('external_ids', {'iface-id': '3bb531cd-ccf4-44a1-8f23-53474ef96150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d6:c2', 'vm-uuid': '872abe6f-2e97-4ac4-98c3-fb52778e33ce'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:16 user nova-compute[75326]: INFO os_vif [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc')
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] No VIF found with MAC fa:16:3e:78:d6:c2, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updated VIF entry in instance network info cache for port 3bb531cd-ccf4-44a1-8f23-53474ef96150. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updating instance_info_cache with network_info: [{"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7fd8206b-eefc-4adf-83d5-cacb5d80a889 req-84c35789-771d-4e41-9c1e-8070a0c42bb4 service nova] Releasing lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:17 user nova-compute[75326]: WARNING nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state None.
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:17 user nova-compute[75326]: WARNING nova.compute.manager [req-8af5cbf3-0cc0-4f48-a343-417bf7de8dd5 req-88321749-dce5-4b99-a8b2-a1bdafbe788f service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state None.
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:17 user nova-compute[75326]: WARNING nova.compute.manager [req-00e238c4-eaaf-4d81-87e5-61aa577f5fba req-d5f2b083-53b9-4ed3-a19a-acaa33c16ba7 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 for instance with vm_state building and task_state spawning.
Dec 06 14:07:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] No waiting events found dispatching network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:19 user nova-compute[75326]: WARNING nova.compute.manager [req-6e80cb3d-dd0b-4115-9c10-3655bfb01206 req-a97bc2d7-6274-4296-9a82-789f76ed55c5 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received unexpected event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 for instance with vm_state active and task_state None.
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:19 user nova-compute[75326]: WARNING nova.compute.manager [req-75de0569-affb-4dd6-90b5-4fb41b02f366 req-4db93d3d-f9a0-4554-83e6-ec0b1c100238 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 for instance with vm_state building and task_state spawning.
Dec 06 14:07:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] No waiting events found dispatching network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:21 user nova-compute[75326]: WARNING nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received unexpected event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 for instance with vm_state active and task_state None.
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] No waiting events found dispatching network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:21 user nova-compute[75326]: WARNING nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received unexpected event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 for instance with vm_state active and task_state None.
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] No waiting events found dispatching network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:21 user nova-compute[75326]: WARNING nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received unexpected event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 for instance with vm_state active and task_state None.
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] No waiting events found dispatching network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:21 user nova-compute[75326]: WARNING nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received unexpected event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 for instance with vm_state active and task_state None.
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] No waiting events found dispatching network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:21 user nova-compute[75326]: WARNING nova.compute.manager [req-5892ed85-5188-4e2d-b99b-1763c726ba4d req-f9cfb4c2-938f-47fa-9443-97445ce393be service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received unexpected event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 for instance with vm_state active and task_state None.
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:07:22 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance spawned successfully.
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:22 user nova-compute[75326]: INFO nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Took 15.57 seconds to spawn the instance on the hypervisor.
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:07:22 user nova-compute[75326]: INFO nova.compute.manager [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Took 16.90 seconds to build instance.
Dec 06 14:07:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-211ed698-9cac-4585-baf7-e79543ef3505 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.099s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:07:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance spawned successfully.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Instance spawned successfully.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Took 13.13 seconds to spawn the instance on the hypervisor.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Took 9.91 seconds to spawn the instance on the hypervisor.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.compute.manager [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Took 15.28 seconds to build instance.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-19d84de3-d8e6-4064-8de9-3c7adf0f513b tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.547s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:23 user nova-compute[75326]: INFO nova.compute.manager [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Took 12.52 seconds to build instance.
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a97f2704-c4a3-4564-95ac-527931474dc9 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.762s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] No waiting events found dispatching network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:23 user nova-compute[75326]: WARNING nova.compute.manager [req-86167dbf-a39a-4db8-bea6-b8b85dcb175a req-1628cdb2-b8b1-4416-9659-f93c03696c91 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received unexpected event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d for instance with vm_state active and task_state None.
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] No waiting events found dispatching network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:26 user nova-compute[75326]: WARNING nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received unexpected event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d for instance with vm_state active and task_state None.
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] No waiting events found dispatching network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:26 user nova-compute[75326]: WARNING nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received unexpected event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa for instance with vm_state active and task_state None.
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] No waiting events found dispatching network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:26 user nova-compute[75326]: WARNING nova.compute.manager [req-65de6adc-4048-4e2a-9655-d00c3d62123e req-c3174ded-0e34-4ab2-be13-cbe7585eee56 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received unexpected event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa for instance with vm_state active and task_state None.
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] No waiting events found dispatching network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:27 user nova-compute[75326]: WARNING nova.compute.manager [req-9a5e46cb-ba95-4d04-8162-84cd82ff055f req-34233dd5-cff8-42f3-a0b5-2e7f9024fe1a service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received unexpected event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 for instance with vm_state active and task_state None.
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=25.74748992919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 0b2d7216-6f98-45c5-9721-185edf751a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance be7c9178-71ea-4b1e-a926-e890d5efd218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:07:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] No waiting events found dispatching network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:07:29 user nova-compute[75326]: WARNING nova.compute.manager [req-07829a6d-ae78-4082-a969-88e891faa632 req-35d5edc5-fa11-4a45-b665-ea2a5e69dbfc service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received unexpected event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 for instance with vm_state active and task_state None.
Dec 06 14:07:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:07:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.133s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:07:30 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid 8b318cff-3431-45bf-8712-ea2d1cd59e3a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updating instance_info_cache with network_info: [{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:07:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:07:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:07:46 user nova-compute[75326]: INFO nova.compute.claims [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Claim successful on node user
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:07:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:47 user nova-compute[75326]: INFO nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Booting with volume a116afbe-deca-42c8-b710-a97a2790d79e at /dev/vda
Dec 06 14:07:47 user nova-compute[75326]: DEBUG nova.policy [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94402c2e73184ad5ae812092d832c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f98481dd6b46f7b5c0dba03e86b557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:07:47 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:07:47 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpzd7cxf7q/privsep.sock']
Dec 06 14:07:47 user sudo[86434]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpzd7cxf7q/privsep.sock
Dec 06 14:07:47 user sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 14:07:48 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully created port: adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully created port: 96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:49 user sudo[86434]: pam_unix(sudo:session): session closed for user root
Dec 06 14:07:49 user nova-compute[75326]: INFO oslo.privsep.daemon [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Spawned new privsep daemon via rootwrap
Dec 06 14:07:49 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 14:07:49 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 14:07:49 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 06 14:07:49 user nova-compute[75326]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86439
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a42d7c-0711-4a4f-ac9c-14aa1d6f473b]: (2,) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bde08a-f7bf-4319-80ec-7c681fab963f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: WARNING os_brick.initiator.connectors.nvmeof [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[170297c8-0152-45a1-867b-a12e5db95883]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[101b719b-5361-4856-9b89-b159562c8455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[366161e5-910f-4921-a989-ecf318951f4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:07:49 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:07:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1af07-6c4d-41ae-b7fd-4386408946aa]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== get_connector_properties: return (1904ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating existing volume attachment record: c9597405-d9cb-4ca1-8fe8-2c43c04f0802 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:07:49 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully created port: 1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully created port: 5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully created port: d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-16ab5c2b-b262-4e95-9f28-e9fd43cb1da5 req-885c3e10-ed83-4f5f-8654-16f033354a16 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: 1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: 3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: 96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port 1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port 3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:55 user nova-compute[75326]: DEBUG nova.network.neutron [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c2e90e61-730f-4e4e-b54c-389dc8b4f28d req-9a6748e5-d3c1-407f-8c5b-c572fa714f75 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:55 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: 1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: 5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-96250c6f-ee4e-40aa-8188-31512e195aff. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port 96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-1227972a-5226-4d99-bf55-12aad4816f0f. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port 1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Successfully updated port: d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-5bd70e39-2afd-42a8-a1b5-1183e42962a2. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port 5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-014ee66a-71dd-4d21-87fb-c9946902ffc0 req-fb03dc28-08cd-44a6-a5e3-48fc1928f214 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:07:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:07:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:07:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-d36702ef-b06c-4a14-a002-facf951c2bd6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:07:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance network_info: |[{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updated VIF entry in instance network info cache for port d36702ef-b06c-4a14-a002-facf951c2bd6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:07:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfe308cd-8a1d-47ed-a571-17e19df1e48f req-5a991a31-f345-42ac-8d8e-251ea4343602 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:00 user nova-compute[75326]: INFO nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Booting with volume 0bb1f481-a136-4291-98bf-22f763853687 at /dev/vdb
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82bf0cf-ad6d-4e3a-b321-b64c4655fe07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174191f-5dcd-44ac-8ffa-69878fc5b595]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb456c3-9d2c-4826-8d1d-bbae0b29504d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe45e0b-6ac0-411a-a074-61b6b2838db6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:00 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590fa1c-74df-4a21-9910-eb7e9d2b1684]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:00 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating existing volume attachment record: 65e0d0b9-3944-40fe-9498-8160e20fc364 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:10 user nova-compute[75326]: INFO nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Booting with volume 77189d4a-2ff6-4b88-a158-23a5ddddc07a at /dev/vdc
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab4b70-c792-4078-8923-28b301861c11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[29920ec8-2a69-4c4c-9e73-80839aa27949]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef80b35f-f2bf-4b36-8f3c-3f1a7acb0ea8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c769f569-b752-495c-bb73-725d8386e0e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:10 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90fd2d-3410-465c-93b0-8c5b409cd2a2]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG os_brick.utils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:10 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating existing volume attachment record: 8f68d20e-e4c1-4bf6-a2c3-6d55b541cf84 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:08:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Creating image(s)
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Ensure instance console log exists: /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Start _get_guest_xml network_info=[{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c9597405-d9cb-4ca1-8fe8-2c43c04f0802', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNDsmQgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b98f861-a8ff-4d36-a2f1-2414f51799cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a116afbe-deca-42c8-b710-a97a2790d79e', 'serial': 'a116afbe-deca-42c8-b710-a97a2790d79e'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '65e0d0b9-3944-40fe-9498-8160e20fc364', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDCTLfUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b98f861-a8ff-4d36-a2f1-2414f51799cd', 'attached_at': '', 'detached_at': '', 'volume_id': '0bb1f481-a136-4291-98bf-22f763853687', 'serial': '0bb1f481-a136-4291-98bf-22f763853687'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '8f68d20e-e4c1-4bf6-a2c3-6d55b541cf84', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNGBWDfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b98f861-a8ff-4d36-a2f1-2414f51799cd', 'attached_at': '', 'detached_at': '', 'volume_id': '77189d4a-2ff6-4b88-a158-23a5ddddc07a', 'serial': '77189d4a-2ff6-4b88-a158-23a5ddddc07a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:08:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connector [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Factory for ISCSI on None {{(pid=75326) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNDsmQgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:20 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86003f5-82b4-4143-a8e5-9cd72a2831b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:20 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[30897c2f-edfd-427f-b80c-2a9c7a44981b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e] added
Dec 06 14:08:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787f057-1997-4dee-85e4-79e7a9d49e08]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[32af835a-ffcd-4d6c-b324-38c0edef5e1b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNDsmQgI {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNDsmQgI" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcdea1f-a8c6-4a7b-a787-9f6ff2404319]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XNDsmQgI'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[11662ba7-4c07-49a9-b755-1dc000e70752]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7efd42-160a-4bfc-9865-8e4d44a435dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:08:20 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:08:20 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 14:08:20 user nova-compute[75326]: 
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c84530-a9ca-45ba-b3c4-454b8729cdef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260]
Dec 06 14:08:20 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780bdee-1161-4245-9940-1c5933a72908]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[97382e0d-3206-4d18-826f-01723dbdd6f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f24c2-8145-4061-b1ee-4b903499af4e]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNDsmQgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '23231353131373464', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231353131373464', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDCTLfUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:21 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:21 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:21 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe94eb6-a50f-4d97-9de1-df5b94c498ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:21 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc20d13-4b72-40e1-8dbb-d711472ad5d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687] added
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb1ebd-8988-4dc5-a439-af5b142fc5d2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bdbac8-e245-4e4e-8363-7e7d4dfe5ad7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDCTLfUa {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDCTLfUa" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205b9e3-e8da-4d9c-b857-ed184b54bb71]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDCTLfUa'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dface520-d9d1-4165-bc1c-0e66f53d57c5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312b01d-bc8c-4c37-8035-0ea11eb591e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceacd6d-7cdd-4fbd-8012-9e5fa9f4cd1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260]
Dec 06 14:08:21 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1984ed1a-b273-448d-80b6-4a4984a41514]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e932a-e2c6-461d-96d6-22f6fad8ac2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:21 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:21 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:21 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab48a9a4-ccde-4a99-adf0-95002a49b594]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDCTLfUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '23365353065363235', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365353065363235', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNGBWDfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:22 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:22 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:22 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd67cf04-31ec-4e5a-a879-20ccc1d23359]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:22 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de5d700-db65-48c9-8333-36aee425a9ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a] added
Dec 06 14:08:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e8443b-4481-434e-aa32-c0984685ea87]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940288e-ebfc-4eac-ab0d-275522a74328]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNGBWDfY {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNGBWDfY" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a29cf1-83d1-4dea-a3d9-13e68e1ea1c8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNGBWDfY'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3a3b3-87c0-4f5f-be28-65d26bf1ee4e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2bb4f-6460-4568-b51e-6e993a48c91c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:08:23 user nova-compute[75326]: INFO nova.compute.claims [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Claim successful on node user
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e2897-ca63-4876-84f3-adf520b4463b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260]
Dec 06 14:08:23 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e27e42-a318-4649-9c34-1707f9c07b2c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f539d3-96b8-4f1e-8291-394a4f0bc1b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:23 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d74dfe-86a5-4019-8a20-c9155287ffe6]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNGBWDfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:08:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.policy [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce486cacce1b41b8b77d6c61df954d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a69d2306b2849a4b43c0c7a405b8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:08:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Creating image(s)
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "/opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "/opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "/opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26162376132616364', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162376132616364', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk 1073741824" returned: 0 in 0.052s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b98f861-a8ff-4d36-a2f1-2414f51799cd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:08:24 user nova-compute[75326]:   <uuid>3b98f861-a8ff-4d36-a2f1-2414f51799cd</uuid>
Dec 06 14:08:24 user nova-compute[75326]:   <name>instance-0000000a</name>
Dec 06 14:08:24 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:08:24 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:08:24 user nova-compute[75326]:   <metadata>
Dec 06 14:08:24 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:08:24 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:name>tempest-device-tagging-server-550594306</nova:name>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:08:20</nova:creationTime>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:08:24 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:08:24 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:owner>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:user uuid="94402c2e73184ad5ae812092d832c022">tempest-TaggedBootDevicesTest-56872621-project-member</nova:user>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:project uuid="94f98481dd6b46f7b5c0dba03e86b557">tempest-TaggedBootDevicesTest-56872621</nova:project>
Dec 06 14:08:24 user nova-compute[75326]:       </nova:owner>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:08:24 user nova-compute[75326]:       <nova:ports>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="1d88babf-3247-42e7-8dd8-c9d5d1d5cacd">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="96250c6f-ee4e-40aa-8188-31512e195aff">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="1227972a-5226-4d99-bf55-12aad4816f0f">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="5bd70e39-2afd-42a8-a1b5-1183e42962a2">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:         <nova:port uuid="d36702ef-b06c-4a14-a002-facf951c2bd6">
Dec 06 14:08:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 14:08:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:24 user nova-compute[75326]:       </nova:ports>
Dec 06 14:08:24 user nova-compute[75326]:     </nova:instance>
Dec 06 14:08:24 user nova-compute[75326]:   </metadata>
Dec 06 14:08:24 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:08:24 user nova-compute[75326]:     <system>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="serial">3b98f861-a8ff-4d36-a2f1-2414f51799cd</entry>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="uuid">3b98f861-a8ff-4d36-a2f1-2414f51799cd</entry>
Dec 06 14:08:24 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:08:24 user nova-compute[75326]:     </system>
Dec 06 14:08:24 user nova-compute[75326]:   </sysinfo>
Dec 06 14:08:24 user nova-compute[75326]:   <os>
Dec 06 14:08:24 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:08:24 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:08:24 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:08:24 user nova-compute[75326]:   </os>
Dec 06 14:08:24 user nova-compute[75326]:   <features>
Dec 06 14:08:24 user nova-compute[75326]:     <acpi/>
Dec 06 14:08:24 user nova-compute[75326]:     <apic/>
Dec 06 14:08:24 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:08:24 user nova-compute[75326]:   </features>
Dec 06 14:08:24 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:08:24 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:08:24 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:08:24 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:08:24 user nova-compute[75326]:   </clock>
Dec 06 14:08:24 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:08:24 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:08:24 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:08:24 user nova-compute[75326]:   </cpu>
Dec 06 14:08:24 user nova-compute[75326]:   <devices>
Dec 06 14:08:24 user nova-compute[75326]:     <disk type="file" device="cdrom">
Dec 06 14:08:24 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 14:08:24 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/disk.config"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="hda" bus="ide"/>
Dec 06 14:08:24 user nova-compute[75326]:     </disk>
Dec 06 14:08:24 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:08:24 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:24 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <serial>a116afbe-deca-42c8-b710-a97a2790d79e</serial>
Dec 06 14:08:24 user nova-compute[75326]:     </disk>
Dec 06 14:08:24 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:08:24 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:24 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <serial>0bb1f481-a136-4291-98bf-22f763853687</serial>
Dec 06 14:08:24 user nova-compute[75326]:     </disk>
Dec 06 14:08:24 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:08:24 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:24 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="vdc" bus="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <serial>77189d4a-2ff6-4b88-a158-23a5ddddc07a</serial>
Dec 06 14:08:24 user nova-compute[75326]:     </disk>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:e5:a0:61"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tapadbfe9f3-4f"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:92:37:07"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tap1d88babf-32"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:27:9d:f6"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tap3cc9805d-3b"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:2e:8e:a5"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tap96250c6f-ee"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:bf:5d:fb"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tap1227972a-52"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:2e:eb:de"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tap5bd70e39-2a"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:24 user nova-compute[75326]:       <mac address="fa:16:3e:cf:8a:7a"/>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:24 user nova-compute[75326]:       <target dev="tapd36702ef-b0"/>
Dec 06 14:08:24 user nova-compute[75326]:     </interface>
Dec 06 14:08:24 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:08:24 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/console.log" append="off"/>
Dec 06 14:08:24 user nova-compute[75326]:     </serial>
Dec 06 14:08:24 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:08:24 user nova-compute[75326]:     <video>
Dec 06 14:08:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:24 user nova-compute[75326]:     </video>
Dec 06 14:08:24 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:08:24 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:08:24 user nova-compute[75326]:     </rng>
Dec 06 14:08:24 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:08:24 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:08:24 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:08:24 user nova-compute[75326]:     </memballoon>
Dec 06 14:08:24 user nova-compute[75326]:   </devices>
Dec 06 14:08:24 user nova-compute[75326]: </domain>
Dec 06 14:08:24 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c07b6076-278b-58e1-81b8-60f73ffd55ce', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadbfe9f3-4f, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadbfe9f3-4f, col_values=(('qos', UUID('fe24bbd6-27f2-46bc-a2fa-98bc33d896d0')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadbfe9f3-4f, col_values=(('external_ids', {'iface-id': 'adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a0:61', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f')
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '510fefa0-eda7-56a3-94e3-7c24637f675e', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d88babf-32, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d88babf-32, col_values=(('qos', UUID('fa12d6d6-55d2-4529-a0cc-dcd1fbc7347f')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d88babf-32, col_values=(('external_ids', {'iface-id': '1d88babf-3247-42e7-8dd8-c9d5d1d5cacd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:37:07', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32')
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f62814c-bbd7-592d-a400-8b0c27fb3141', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cc9805d-3b, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cc9805d-3b, col_values=(('qos', UUID('2609e69a-9a12-47ce-b98a-b1b02b06bf91')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cc9805d-3b, col_values=(('external_ids', {'iface-id': '3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9d:f6', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b')
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4536e2cf-1396-50f7-917d-4e8148512929', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Cannot resize image /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Ensure instance console log exists: /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96250c6f-ee, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96250c6f-ee, col_values=(('qos', UUID('196ded1e-5aa7-4dd8-ae38-dc20e188a290')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96250c6f-ee, col_values=(('external_ids', {'iface-id': '96250c6f-ee4e-40aa-8188-31512e195aff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:8e:a5', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Successfully created port: 92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee')
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e746cecc-ebc9-5677-aaf3-b8f0986eb2b2', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1227972a-52, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1227972a-52, col_values=(('qos', UUID('60c3719e-ee70-4c26-8c7a-43e9d82eeb0e')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1227972a-52, col_values=(('external_ids', {'iface-id': '1227972a-5226-4d99-bf55-12aad4816f0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:5d:fb', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52')
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebaee1e5-401d-55e7-bbee-bfa1c7fc208c', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd70e39-2a, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bd70e39-2a, col_values=(('qos', UUID('27c558fe-81b6-410f-9e89-7e32bb12eac8')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bd70e39-2a, col_values=(('external_ids', {'iface-id': '5bd70e39-2afd-42a8-a1b5-1183e42962a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:eb:de', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a')
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca33bf14-6a36-5928-9172-3a41117b59ca', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd36702ef-b0, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd36702ef-b0, col_values=(('qos', UUID('4bd2100d-a46f-44cc-81a5-da3d3fb1beb2')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd36702ef-b0, col_values=(('external_ids', {'iface-id': 'd36702ef-b06c-4a14-a002-facf951c2bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:8a:7a', 'vm-uuid': '3b98f861-a8ff-4d36-a2f1-2414f51799cd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:25 user nova-compute[75326]: INFO os_vif [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0')
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] No BDM found with device name hda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] No VIF found with MAC fa:16:3e:e5:a0:61, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] No VIF found with MAC fa:16:3e:bf:5d:fb, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Using config drive
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Successfully updated port: 92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquired lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-changed-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Refreshing instance network info cache due to event network-changed-92a2a357-7508-4527-8d65-c1f629ce44e0. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] Acquiring lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:08:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Creating config drive at /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/disk.config
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpovq7eyod {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpovq7eyod" returned: 0 in 0.069s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Updating instance_info_cache with network_info: [{"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Releasing lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Instance network_info: |[{"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] Acquired lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Refreshing network info cache for port 92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Start _get_guest_xml network_info=[{"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:08:25 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:25 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-338647744',display_name='tempest-ServersNegativeTestJSON-server-338647744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-338647744',id=11,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-8sx54rmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:08:24Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=365e5848-c71d-4ecc-97f9-bd8b051c4a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.objects.instance [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lazy-loading 'pci_devices' on Instance uuid 365e5848-c71d-4ecc-97f9-bd8b051c4a6d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:08:25 user nova-compute[75326]:   <uuid>365e5848-c71d-4ecc-97f9-bd8b051c4a6d</uuid>
Dec 06 14:08:25 user nova-compute[75326]:   <name>instance-0000000b</name>
Dec 06 14:08:25 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:08:25 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:08:25 user nova-compute[75326]:   <metadata>
Dec 06 14:08:25 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:08:25 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:name>tempest-ServersNegativeTestJSON-server-338647744</nova:name>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:08:25</nova:creationTime>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:08:25 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:08:25 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:owner>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:user uuid="ce486cacce1b41b8b77d6c61df954d6b">tempest-ServersNegativeTestJSON-569900546-project-member</nova:user>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:project uuid="7a69d2306b2849a4b43c0c7a405b8ffb">tempest-ServersNegativeTestJSON-569900546</nova:project>
Dec 06 14:08:25 user nova-compute[75326]:       </nova:owner>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:08:25 user nova-compute[75326]:       <nova:ports>
Dec 06 14:08:25 user nova-compute[75326]:         <nova:port uuid="92a2a357-7508-4527-8d65-c1f629ce44e0">
Dec 06 14:08:25 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:08:25 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:25 user nova-compute[75326]:       </nova:ports>
Dec 06 14:08:25 user nova-compute[75326]:     </nova:instance>
Dec 06 14:08:25 user nova-compute[75326]:   </metadata>
Dec 06 14:08:25 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:08:25 user nova-compute[75326]:     <system>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="serial">365e5848-c71d-4ecc-97f9-bd8b051c4a6d</entry>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="uuid">365e5848-c71d-4ecc-97f9-bd8b051c4a6d</entry>
Dec 06 14:08:25 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:08:25 user nova-compute[75326]:     </system>
Dec 06 14:08:25 user nova-compute[75326]:   </sysinfo>
Dec 06 14:08:25 user nova-compute[75326]:   <os>
Dec 06 14:08:25 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:08:25 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:08:25 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:08:25 user nova-compute[75326]:   </os>
Dec 06 14:08:25 user nova-compute[75326]:   <features>
Dec 06 14:08:25 user nova-compute[75326]:     <acpi/>
Dec 06 14:08:25 user nova-compute[75326]:     <apic/>
Dec 06 14:08:25 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:08:25 user nova-compute[75326]:   </features>
Dec 06 14:08:25 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:08:25 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:08:25 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:08:25 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:08:25 user nova-compute[75326]:   </clock>
Dec 06 14:08:25 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:08:25 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:08:25 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:08:25 user nova-compute[75326]:   </cpu>
Dec 06 14:08:25 user nova-compute[75326]:   <devices>
Dec 06 14:08:25 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:08:25 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:08:25 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk"/>
Dec 06 14:08:25 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:08:25 user nova-compute[75326]:     </disk>
Dec 06 14:08:25 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:25 user nova-compute[75326]:       <mac address="fa:16:3e:67:9c:93"/>
Dec 06 14:08:25 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:25 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:25 user nova-compute[75326]:       <target dev="tap92a2a357-75"/>
Dec 06 14:08:25 user nova-compute[75326]:     </interface>
Dec 06 14:08:25 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:08:25 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/console.log" append="off"/>
Dec 06 14:08:25 user nova-compute[75326]:     </serial>
Dec 06 14:08:25 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:08:25 user nova-compute[75326]:     <video>
Dec 06 14:08:25 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:25 user nova-compute[75326]:     </video>
Dec 06 14:08:25 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:08:25 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:08:25 user nova-compute[75326]:     </rng>
Dec 06 14:08:25 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:08:25 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:08:25 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:08:25 user nova-compute[75326]:     </memballoon>
Dec 06 14:08:25 user nova-compute[75326]:   </devices>
Dec 06 14:08:25 user nova-compute[75326]: </domain>
Dec 06 14:08:25 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-338647744',display_name='tempest-ServersNegativeTestJSON-server-338647744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-338647744',id=11,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-8sx54rmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:08:24Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=365e5848-c71d-4ecc-97f9-bd8b051c4a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG os_vif [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5ff5374-d5cd-5e31-bb75-a2d1bf7c19bd', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92a2a357-75, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92a2a357-75, col_values=(('qos', UUID('9b3fc512-8eb3-4663-b75f-0dc50162198e')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92a2a357-75, col_values=(('external_ids', {'iface-id': '92a2a357-7508-4527-8d65-c1f629ce44e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:9c:93', 'vm-uuid': '365e5848-c71d-4ecc-97f9-bd8b051c4a6d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:26 user nova-compute[75326]: INFO os_vif [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75')
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=25.624496459960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lazy-loading 'flavor' on Instance uuid 0b2d7216-6f98-45c5-9721-185edf751a53 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] No VIF found with MAC fa:16:3e:67:9c:93, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Updated VIF entry in instance network info cache for port 92a2a357-7508-4527-8d65-c1f629ce44e0. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Updating instance_info_cache with network_info: [{"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-232f9c6f-1704-4b62-bf41-09ed98f32a2b req-756df51f-fec0-4bb1-a3e8-c0b05d0a9b7d service nova] Releasing lock "refresh_cache-365e5848-c71d-4ecc-97f9-bd8b051c4a6d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 0b2d7216-6f98-45c5-9721-185edf751a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance be7c9178-71ea-4b1e-a926-e890d5efd218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 3b98f861-a8ff-4d36-a2f1-2414f51799cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 365e5848-c71d-4ecc-97f9-bd8b051c4a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:26 user nova-compute[75326]: INFO nova.compute.manager [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Attaching volume cc56e9cb-117e-436b-a256-1bf300695baa to /dev/vdb
Dec 06 14:08:26 user nova-compute[75326]: DEBUG os_brick.utils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed925a-7bcd-43d0-81f8-15516e13ff05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7533be-4741-4f24-85a6-6f3569602639]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e113eb6-9889-4bba-b2ee-efdd7d030a42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa017a7-a373-475f-87d0-18d45ff3cf1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:27 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e49960-c2aa-43e7-a50e-c81e2982e794]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG os_brick.utils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating existing volume attachment record: c3ebc7a3-ccad-427d-9846-72a7326088bc {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-changed-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Refreshing instance network info cache due to event network-changed-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Refreshing network info cache for port b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:27 user nova-compute[75326]: WARNING nova.compute.manager [req-7a9479d0-f65d-4f1a-a977-a5b51ef2f17b req-69328dbf-3fa7-47ab-8f88-8cd350e27ec1 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e for instance with vm_state building and task_state spawning.
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updated VIF entry in instance network info cache for port b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8191b0b-e74c-4559-b02e-da3a23c273b3 req-50a9be2a-daa0-4445-a277-3f2ef7b6cc33 service nova] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating instance_info_cache with network_info: [{"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-0b2d7216-6f98-45c5-9721-185edf751a53" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:08:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:29 user nova-compute[75326]: WARNING nova.compute.manager [req-f66a5929-4794-48e7-98f3-f091f8aebb6a req-445234de-2768-430b-8a54-08f36e46d56e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 for instance with vm_state building and task_state spawning.
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:29 user nova-compute[75326]: WARNING nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e for instance with vm_state building and task_state spawning.
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:29 user nova-compute[75326]: WARNING nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd for instance with vm_state building and task_state spawning.
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:29 user nova-compute[75326]: WARNING nova.compute.manager [req-ae88cdbf-3145-4fa2-b24c-54df6e94e3ef req-e1960a4e-c9e3-4638-bf82-c9aec95b2606 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd for instance with vm_state building and task_state spawning.
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:30 user nova-compute[75326]: WARNING nova.compute.manager [req-d7f6603d-b580-4789-aa77-6596f43210cc req-57ff0a78-28a3-4d47-a7e4-33c7832ae917 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f for instance with vm_state building and task_state spawning.
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:31 user nova-compute[75326]: WARNING nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 for instance with vm_state building and task_state spawning.
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-changed-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Refreshing instance network info cache due to event network-changed-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquired lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Refreshing network info cache for port 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:31 user nova-compute[75326]: WARNING nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 for instance with vm_state building and task_state spawning.
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:31 user nova-compute[75326]: WARNING nova.compute.manager [req-47c334f6-5ff6-4b4b-a10a-adbdec971254 req-daf5d865-9887-441d-be90-b98a2a95d065 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 for instance with vm_state building and task_state spawning.
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.203s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:31 user nova-compute[75326]: INFO nova.compute.manager [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Attaching volume 1a1d9f39-ed37-45ff-a0b8-f40e976444b3 to /dev/vdb
Dec 06 14:08:31 user nova-compute[75326]: DEBUG os_brick.utils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3cdcd-f234-45d9-9523-a0dbe421e8dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a29cf9-f97b-4dee-9384-a20136ebe347]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27931c-8ae0-47ff-b21a-8eacdf669ba0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[760237ac-d3c2-45b5-a078-03f7f448c6bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18cbdc-c255-4930-a7a8-9c5968d009e1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG os_brick.utils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating existing volume attachment record: 4e647df6-31bf-4f28-a0f9-84902b6fe5ee {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.network.neutron [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updated VIF entry in instance network info cache for port 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.network.neutron [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Releasing lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] No waiting events found dispatching network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received unexpected event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] No waiting events found dispatching network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received unexpected event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-dbec0302-fbdd-4f36-9f69-7df18cfacee8 req-6580804f-c398-43e2-81ce-b93f43d932d4 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:32 user nova-compute[75326]: WARNING nova.compute.manager [req-445d6372-532b-4689-b318-3b0b5eb93ffa req-e99315e8-0c29-4165-b598-723ed681b9ef service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 for instance with vm_state building and task_state spawning.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:08:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Instance spawned successfully.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.objects.instance [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:32 user nova-compute[75326]: INFO nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Took 8.95 seconds to spawn the instance on the hypervisor.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:32 user nova-compute[75326]: INFO nova.compute.manager [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Took 9.94 seconds to build instance.
Dec 06 14:08:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-364ffcc5-3d35-48be-bdda-1a3e4777753d tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.051s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:08:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance spawned successfully.
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:33 user nova-compute[75326]: INFO nova.compute.manager [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Attaching volume e1dcceba-da5b-45e1-b9fc-76f1434159af to /dev/vdb
Dec 06 14:08:33 user nova-compute[75326]: INFO nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Took 13.06 seconds to spawn the instance on the hypervisor.
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.utils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[369cbe72-074c-4385-9525-6fdfc85bfd57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab678d98-9020-4041-8b5d-25ab529c8773]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6734f06-549b-4af5-a73a-47f90d4def43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c94452-ab39-41cf-912a-c297041aa655]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:33 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24b8f2-4cbb-4072-850a-567d7b70c9bb]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG os_brick.utils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating existing volume attachment record: fe2c0197-46ea-49ef-b70f-0f171280ae65 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:33 user nova-compute[75326]: INFO nova.compute.manager [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Took 46.45 seconds to build instance.
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c42-3329-4927-b9a8-f8ee329bb4cc tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.556s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-changed-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Refreshing instance network info cache due to event network-changed-765ea7bc-2156-4815-bede-834d676d7edd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Refreshing network info cache for port 765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updated VIF entry in instance network info cache for port 765ea7bc-2156-4815-bede-834d676d7edd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78a2538d-3d83-4643-b482-16e06d352769 req-f5f546ec-77f5-471d-9b79-81c320423595 service nova] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMZkhmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:38 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:38 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:38 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8b11f3-7acf-428d-bc3f-0acd9e6345ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:38 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7787dae-c893-4a25-8a3f-27940aaf4e01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa] added
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2fd78a-b25c-4b5d-a38d-994e8f13ee3c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bca4f-65a7-4888-9c4d-026e5e2aa881]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMZkhmeB {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMZkhmeB" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba9477e-2fa5-43af-9b20-3888e9278803]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IMZkhmeB'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f28a6-5fb0-460e-a9e5-c1bff591d818]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b970e30f-4936-4d4b-bdb2-774f820def48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[628855e5-67ab-4a5d-9fe8-5afcc679d3d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260]
Dec 06 14:08:38 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[592dd186-0c84-449a-b214-57aa064367a2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[66746a28-36a5-457d-b2c3-9ebebaaf5979]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:38 user nova-compute[75326]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)
Dec 06 14:08:38 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[970abbe1-1544-432a-bd5a-0a93b173e925]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMZkhmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23664396361343531', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664396361343531', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lazy-loading 'flavor' on Instance uuid 0b2d7216-6f98-45c5-9721-185edf751a53 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:08:39 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:39 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:08:39 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:08:39 user nova-compute[75326]:   <serial>cc56e9cb-117e-436b-a256-1bf300695baa</serial>
Dec 06 14:08:39 user nova-compute[75326]: </disk>
Dec 06 14:08:39 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:08:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] No VIF found with MAC fa:16:3e:bd:b4:15, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c7deb760-9804-4bad-97c1-d4b3e9572eb7 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.653s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:41 user nova-compute[75326]: INFO nova.compute.manager [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Terminating instance
Dec 06 14:08:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-unplugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] No waiting events found dispatching network-vif-unplugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-449faecf-3bbc-4a4a-9105-0debb83f5101 req-6d627721-5871-489c-a791-cbcf69c71871 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-unplugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:08:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Instance destroyed successfully.
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lazy-loading 'resources' on Instance uuid 0b2d7216-6f98-45c5-9721-185edf751a53 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1422239706',display_name='tempest-DeleteServersTestJSON-server-1422239706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1422239706',id=2,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79ce1f74331b40d29f8515f604a49b8a',ramdisk_id='',reservation_id='r-1xej6vp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1808113997',owner_user_name='tempest-DeleteServersTestJSON-1808113997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:06:54Z,user_data=None,user_id='357791a6ab6d43ffb514b884d5af4686',uuid=0b2d7216-6f98-45c5-9721-185edf751a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converting VIF {"id": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "address": "fa:16:3e:bd:b4:15", "network": {"id": "1535dfc2-bd4b-45fa-956d-921a958bda17", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-510945107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79ce1f74331b40d29f8515f604a49b8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e73bbd5-40", "ovs_interfaceid": "4e73bbd5-40ee-43a0-81d1-2349bcac0536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_vif [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e73bbd5-40, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b361b7ef-1fcb-45aa-a482-2324ef669d78) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: INFO os_vif [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=4e73bbd5-40ee-43a0-81d1-2349bcac0536,network=Network(1535dfc2-bd4b-45fa-956d-921a958bda17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e73bbd5-40')
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMZkhmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be33e41-9f82-4c4e-9484-e3bbb314b920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:08:42 user nova-compute[75326]: No targets found.
Dec 06 14:08:42 user nova-compute[75326]: iSNS:
Dec 06 14:08:42 user nova-compute[75326]: No targets found.
Dec 06 14:08:42 user nova-compute[75326]: STATIC:
Dec 06 14:08:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa
Dec 06 14:08:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:08:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:08:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:08:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:08:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:08:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:08:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:08:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:08:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:08:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:08:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:08:42 user nova-compute[75326]: FIRMWARE:
Dec 06 14:08:42 user nova-compute[75326]: No targets found.
Dec 06 14:08:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:08:42 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:08:42 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[499b41dc-3268-4376-9849-a3c96464bfeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9044021-9e1e-4318-b58d-f4b9300c0a37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)
Dec 06 14:08:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:42 user nova-compute[75326]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa (non-flash)
Dec 06 14:08:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc2d5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870c1fd-79b0-43a2-8253-b50aa8e66a9a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17554df2-271d-48d2-813b-8fd86e1824c9]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9730b-c19d-478f-a5de-2878c171ac58]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeaa45f-af92-475d-bef6-e0beb7a10bfd]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8324dc3-6b6e-4821-9fbc-b3e7ed266d95]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1fa41-587c-4d7a-9d15-6c8a86933f98]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260]
Dec 06 14:08:42 user nova-compute[75326]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc56e9cb-117e-436b-a256-1bf300695baa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c43526-d3e7-486e-a3aa-86cb409ed633]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] <== disconnect_volume: return (310ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:08:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Deleting instance files /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53_del
Dec 06 14:08:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Deletion of /opt/stack/data/nova/instances/0b2d7216-6f98-45c5-9721-185edf751a53_del complete
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75326) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 06 14:08:42 user nova-compute[75326]: INFO nova.virt.libvirt.host [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] UEFI support detected
Dec 06 14:08:42 user nova-compute[75326]: INFO nova.compute.manager [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Took 1.31 seconds to destroy the instance on the hypervisor.
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:42 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b143ba72-b647-4a2f-90c8-228a257d959d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:43 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee455e-ec1a-4dfb-9dc8-d6414029c5a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3] added
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c02001-cc47-4e3b-a2b5-b6c6a5a45d77]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[62288f3c-333a-4604-b479-50233304170d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBDTnXQ {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBDTnXQ" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401f286-d82a-47e7-8c01-261fd307ef9d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybBDTnXQ'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b4e46-8b64-45e6-8fd2-ef9d5067b64e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6837135b-f9ff-4d60-b5d4-4f9240a68a04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[da00826d-4c3a-4389-b556-6eb9a7b7b238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]
Dec 06 14:08:43 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a96b99-3b97-4021-ab07-9dcaed47b6ad]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6163c3b-5d2f-4467-9232-fa7915c75a35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[994c8eb7-dd89-4fc8-a004-4c75b489fc76]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-70f9177a-78ad-42d7-84a9-b065c3d05df3 req-18142269-e311-40ec-9392-9ee3f37c9b4e service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-deleted-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:43 user nova-compute[75326]: INFO nova.compute.manager [req-70f9177a-78ad-42d7-84a9-b065c3d05df3 req-18142269-e311-40ec-9392-9ee3f37c9b4e service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Neutron deleted interface 4e73bbd5-40ee-43a0-81d1-2349bcac0536; detaching it from the instance and deleting it from the info cache
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-70f9177a-78ad-42d7-84a9-b065c3d05df3 req-18142269-e311-40ec-9392-9ee3f37c9b4e service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:43 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Took 0.95 seconds to deallocate network for instance.
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-70f9177a-78ad-42d7-84a9-b065c3d05df3 req-18142269-e311-40ec-9392-9ee3f37c9b4e service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Detach interface failed, port_id=4e73bbd5-40ee-43a0-81d1-2349bcac0536, reason: Instance 0b2d7216-6f98-45c5-9721-185edf751a53 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] Acquiring lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] Lock "0b2d7216-6f98-45c5-9721-185edf751a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] No waiting events found dispatching network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:43 user nova-compute[75326]: WARNING nova.compute.manager [req-9b8efabd-5e8b-4ceb-a03a-00113b7680e4 req-86c29569-371c-447d-9513-0aa5120ad823 service nova] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Received unexpected event network-vif-plugged-4e73bbd5-40ee-43a0-81d1-2349bcac0536 for instance with vm_state active and task_state deleting.
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psDIbLxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:44 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23065616364616435', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616364616435', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.140s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:44 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:08:44 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.objects.instance [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79eaac5-0633-4b0a-80b5-7d928f8837e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:08:44 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:08:44 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:44 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:08:44 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:08:44 user nova-compute[75326]:   <serial>1a1d9f39-ed37-45ff-a0b8-f40e976444b3</serial>
Dec 06 14:08:44 user nova-compute[75326]: </disk>
Dec 06 14:08:44 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcb34b1-51a0-43c2-b9f7-8276047539b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af] added
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: INFO nova.compute.manager [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] [instance: 0b2d7216-6f98-45c5-9721-185edf751a53] Took 0.96 seconds to detach 1 volumes for instance.
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af46d7d-4671-4cea-b341-905c539c8516]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dae7b0-3d87-4e38-9b13-b5ac84dd3f8b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psDIbLxj {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psDIbLxj" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da9ce5-6e47-4fcd-8cb3-97cbd8791b86]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psDIbLxj'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b79a48-3600-4518-869e-5e75316a4695]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b35e8-6024-4776-8fa6-65963526ab70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[795c0b50-1040-4730-ab7c-f9f7540ce84f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260]
Dec 06 14:08:44 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260] successful.
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762a01e-5584-4b37-a3d0-0d8a6f54b074]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f55634-be5b-41c6-bf81-0d3796fc7192]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:08:44 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:08:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[701017b4-773f-4c4b-bc4c-634d61a1364b]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psDIbLxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No VIF found with MAC fa:16:3e:f6:6b:62, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21207454-7d98-4e64-88be-008b11f0ebfb tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.130s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:44 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Deleted allocations for instance 0b2d7216-6f98-45c5-9721-185edf751a53
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e00c1f9f-22d8-4982-b609-4e238ee5dda1 tempest-DeleteServersTestJSON-1808113997 tempest-DeleteServersTestJSON-1808113997-project-member] Lock "0b2d7216-6f98-45c5-9721-185edf751a53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.911s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75326) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:45 user nova-compute[75326]: WARNING nova.compute.manager [req-c4bb3db1-0a42-46a7-9536-e87ef18efa4f req-5a374797-7983-45c0-a3f5-b6f98cb5d7b5 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state active and task_state powering-off.
Dec 06 14:08:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '26136313235333238', 'path': '/dev/sdf'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313235333238', 'path': '/dev/sdf'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:08:45 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:08:45 user nova-compute[75326]:   <source dev="/dev/sdf"/>
Dec 06 14:08:45 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:08:45 user nova-compute[75326]:   <serial>e1dcceba-da5b-45e1-b9fc-76f1434159af</serial>
Dec 06 14:08:45 user nova-compute[75326]: </disk>
Dec 06 14:08:45 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:08:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:37:b8:45, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-acf2f294-4b89-45fd-b0db-c486df9eb407 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.214s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance destroyed successfully.
Dec 06 14:08:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:08:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f4bbc160-577d-4acc-9eab-f5ff50d33bae tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.264s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:47 user nova-compute[75326]: WARNING nova.compute.manager [req-ac6c203b-2c09-40a5-828c-b0dc184c7a04 req-ecefa401-a266-4b14-8943-d5cabedb164c service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state None.
Dec 06 14:08:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:08:50 user nova-compute[75326]: INFO nova.compute.claims [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Claim successful on node user
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:08:50 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.policy [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ea783d27940479b9d78a93500062e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56d8164e56e499c90eca8cb27e98bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:08:50 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Creating image(s)
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "/opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk 1073741824" returned: 0 in 0.046s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Successfully created port: 3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Cannot resize image /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Ensure instance console log exists: /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-changed-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Refreshing instance network info cache due to event network-changed-5510da4c-bf2a-4782-b0ab-7aff4db2e74d. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] Acquiring lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] Acquired lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Refreshing network info cache for port 5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Successfully updated port: 3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquired lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-changed-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Refreshing instance network info cache due to event network-changed-3d2f9c06-ac9c-408c-bea1-0227694ab74c. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] Acquiring lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updated VIF entry in instance network info cache for port 5510da4c-bf2a-4782-b0ab-7aff4db2e74d. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating instance_info_cache with network_info: [{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbdb96a1-6eb7-401b-a312-058665324a21 req-ad7dec15-0532-4631-b40c-be0faf523697 service nova] Releasing lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updating instance_info_cache with network_info: [{"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Releasing lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Instance network_info: |[{"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] Acquired lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Refreshing network info cache for port 3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Start _get_guest_xml network_info=[{"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:08:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1807003604',display_name='tempest-AttachVolumeNegativeTest-server-1807003604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1807003604',id=12,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQZMW6WSaRVpFwkdPgoOR38fdLFJhEpZ/coOa7Ntc5VTn7xPSlMF9hwwT5ypjmkqIrxXMmwXdfO/wBNbB0EzQk3Op8HBp9mCX4p0wdZVagr8lHTUNYKMSCtu9WNbgW7A==',key_name='tempest-keypair-1384688403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-tr51lpsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=23c0e05a-eef8-4b0c-b15d-2263997734b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'pci_devices' on Instance uuid 23c0e05a-eef8-4b0c-b15d-2263997734b5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:08:53 user nova-compute[75326]:   <uuid>23c0e05a-eef8-4b0c-b15d-2263997734b5</uuid>
Dec 06 14:08:53 user nova-compute[75326]:   <name>instance-0000000c</name>
Dec 06 14:08:53 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:08:53 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:08:53 user nova-compute[75326]:   <metadata>
Dec 06 14:08:53 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:08:53 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1807003604</nova:name>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:08:53</nova:creationTime>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:08:53 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:08:53 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:owner>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:user uuid="6ea783d27940479b9d78a93500062e8e">tempest-AttachVolumeNegativeTest-1014509330-project-member</nova:user>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:project uuid="f56d8164e56e499c90eca8cb27e98bf9">tempest-AttachVolumeNegativeTest-1014509330</nova:project>
Dec 06 14:08:53 user nova-compute[75326]:       </nova:owner>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:08:53 user nova-compute[75326]:       <nova:ports>
Dec 06 14:08:53 user nova-compute[75326]:         <nova:port uuid="3d2f9c06-ac9c-408c-bea1-0227694ab74c">
Dec 06 14:08:53 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:08:53 user nova-compute[75326]:         </nova:port>
Dec 06 14:08:53 user nova-compute[75326]:       </nova:ports>
Dec 06 14:08:53 user nova-compute[75326]:     </nova:instance>
Dec 06 14:08:53 user nova-compute[75326]:   </metadata>
Dec 06 14:08:53 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:08:53 user nova-compute[75326]:     <system>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="serial">23c0e05a-eef8-4b0c-b15d-2263997734b5</entry>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="uuid">23c0e05a-eef8-4b0c-b15d-2263997734b5</entry>
Dec 06 14:08:53 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:08:53 user nova-compute[75326]:     </system>
Dec 06 14:08:53 user nova-compute[75326]:   </sysinfo>
Dec 06 14:08:53 user nova-compute[75326]:   <os>
Dec 06 14:08:53 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:08:53 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:08:53 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:08:53 user nova-compute[75326]:   </os>
Dec 06 14:08:53 user nova-compute[75326]:   <features>
Dec 06 14:08:53 user nova-compute[75326]:     <acpi/>
Dec 06 14:08:53 user nova-compute[75326]:     <apic/>
Dec 06 14:08:53 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:08:53 user nova-compute[75326]:   </features>
Dec 06 14:08:53 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:08:53 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:08:53 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:08:53 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:08:53 user nova-compute[75326]:   </clock>
Dec 06 14:08:53 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:08:53 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:08:53 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:08:53 user nova-compute[75326]:   </cpu>
Dec 06 14:08:53 user nova-compute[75326]:   <devices>
Dec 06 14:08:53 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:08:53 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:08:53 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk"/>
Dec 06 14:08:53 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:08:53 user nova-compute[75326]:     </disk>
Dec 06 14:08:53 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:08:53 user nova-compute[75326]:       <mac address="fa:16:3e:d1:df:e5"/>
Dec 06 14:08:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:53 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:08:53 user nova-compute[75326]:       <target dev="tap3d2f9c06-ac"/>
Dec 06 14:08:53 user nova-compute[75326]:     </interface>
Dec 06 14:08:53 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:08:53 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/console.log" append="off"/>
Dec 06 14:08:53 user nova-compute[75326]:     </serial>
Dec 06 14:08:53 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:08:53 user nova-compute[75326]:     <video>
Dec 06 14:08:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:08:53 user nova-compute[75326]:     </video>
Dec 06 14:08:53 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:08:53 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:08:53 user nova-compute[75326]:     </rng>
Dec 06 14:08:53 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:08:53 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:08:53 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:08:53 user nova-compute[75326]:     </memballoon>
Dec 06 14:08:53 user nova-compute[75326]:   </devices>
Dec 06 14:08:53 user nova-compute[75326]: </domain>
Dec 06 14:08:53 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1807003604',display_name='tempest-AttachVolumeNegativeTest-server-1807003604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1807003604',id=12,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQZMW6WSaRVpFwkdPgoOR38fdLFJhEpZ/coOa7Ntc5VTn7xPSlMF9hwwT5ypjmkqIrxXMmwXdfO/wBNbB0EzQk3Op8HBp9mCX4p0wdZVagr8lHTUNYKMSCtu9WNbgW7A==',key_name='tempest-keypair-1384688403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-tr51lpsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=23c0e05a-eef8-4b0c-b15d-2263997734b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG os_vif [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ee4ed03-c7a8-57eb-aaeb-a5a3068783fc', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d2f9c06-ac, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d2f9c06-ac, col_values=(('qos', UUID('ff0a8a8e-2b30-43a1-a45e-eae199d15215')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d2f9c06-ac, col_values=(('external_ids', {'iface-id': '3d2f9c06-ac9c-408c-bea1-0227694ab74c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:df:e5', 'vm-uuid': '23c0e05a-eef8-4b0c-b15d-2263997734b5'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:53 user nova-compute[75326]: INFO os_vif [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac')
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:d1:df:e5, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updated VIF entry in instance network info cache for port 3d2f9c06-ac9c-408c-bea1-0227694ab74c. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updating instance_info_cache with network_info: [{"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-044b15d0-c636-4517-9ee2-8854482d763b req-b116d7ae-8623-435b-b01f-16d1d55400d5 service nova] Releasing lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] No waiting events found dispatching network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:54 user nova-compute[75326]: WARNING nova.compute.manager [req-67d22beb-a75f-4a51-91ea-f8f333df08fd req-f56dbc7f-7806-47e6-a856-76a8344723a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received unexpected event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c for instance with vm_state building and task_state spawning.
Dec 06 14:08:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'flavor' on Instance uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:55 user nova-compute[75326]: INFO nova.compute.manager [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Attaching volume db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 to /dev/vdb
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.utils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8eb5b-0e64-4597-9c46-0633ec76b446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[186934d8-7ee6-40fa-af40-6810b1e7598f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[877240d6-2f07-48fb-a247-1b3845e196a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d03564-3820-43cf-bf20-964a519321a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:08:55 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:08:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59c85ac-0dab-47b9-980f-4c9b3962f867]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG os_brick.utils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:08:55 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating existing volume attachment record: 33b4e6a5-1af2-4378-bdc8-cc4b5e7c47ec {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-changed-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing instance network info cache due to event network-changed-f686132b-b2e9-4590-a52a-1e0e6e1bf504. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing network info cache for port f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.objects.instance [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:08:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Instance spawned successfully.
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:08:57 user nova-compute[75326]: INFO nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Took 6.17 seconds to spawn the instance on the hypervisor.
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] No waiting events found dispatching network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:08:57 user nova-compute[75326]: WARNING nova.compute.manager [req-a4ff64b2-35db-4808-857f-1c894b72fe3b req-70d8fd32-982f-452d-9d5c-7f4deab42a67 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received unexpected event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c for instance with vm_state building and task_state spawning.
Dec 06 14:08:57 user nova-compute[75326]: INFO nova.compute.manager [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Took 7.08 seconds to build instance.
Dec 06 14:08:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2b9567cf-ec3e-4553-8aa3-20fe8575a792 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.176s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updated VIF entry in instance network info cache for port f686132b-b2e9-4590-a52a-1e0e6e1bf504. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c1d28b2-34e7-429c-9443-29c1084246dc req-e6c75780-ec2d-4921-9b84-5702ec003fb6 service nova] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.objects.instance [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'pci_requests' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.objects.base [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Object Instance<03196bf5-7f24-4a32-b7ce-e3b0560ee0bb> lazy-loaded attributes: flavor,pci_requests {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG nova.policy [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a403f032e48e4862b04d4fdb8680b40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0cd38d55641fb8af4654ad2a95c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:08:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Successfully created port: a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Successfully updated port: a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-changed-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing instance network info cache due to event network-changed-a73d21ea-90ad-4f4a-8f63-8345cf69daea. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-changed-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Refreshing instance network info cache due to event network-changed-5a557284-877d-4b20-9636-c231962e9aaa. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] Acquiring lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] Acquired lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Refreshing network info cache for port 5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Refreshing network info cache for port a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG os_vif [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fcf9143-bc56-515a-8d7e-f4495b21ef38', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73d21ea-90, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73d21ea-90, col_values=(('qos', UUID('be2db3a0-deff-45ae-b245-14057a048895')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73d21ea-90, col_values=(('external_ids', {'iface-id': 'a73d21ea-90ad-4f4a-8f63-8345cf69daea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:8c:d7', 'vm-uuid': '03196bf5-7f24-4a32-b7ce-e3b0560ee0bb'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: INFO os_vif [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90')
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] attach device xml: <interface type="ethernet">
Dec 06 14:08:59 user nova-compute[75326]:   <mac address="fa:16:3e:91:8c:d7"/>
Dec 06 14:08:59 user nova-compute[75326]:   <model type="virtio"/>
Dec 06 14:08:59 user nova-compute[75326]:   <mtu size="1442"/>
Dec 06 14:08:59 user nova-compute[75326]:   <target dev="tapa73d21ea-90"/>
Dec 06 14:08:59 user nova-compute[75326]: </interface>
Dec 06 14:08:59 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:08:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updated VIF entry in instance network info cache for port 5a557284-877d-4b20-9636-c231962e9aaa. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updating instance_info_cache with network_info: [{"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-85f05b43-b950-45c4-b68a-505f82d50fc7 req-38283646-f6dd-4a4c-ad8b-bbd06910e365 service nova] Releasing lock "refresh_cache-ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name hda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No VIF found with MAC fa:16:3e:b8:51:61, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:00 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:00</nova:creationTime>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:00 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:00 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:00 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:00 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:00 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:00 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:00 user nova-compute[75326]:     <nova:port uuid="a73d21ea-90ad-4f4a-8f63-8345cf69daea">
Dec 06 14:09:00 user nova-compute[75326]:       <nova:ip type="fixed" address="10.10.10.190" ipVersion="4"/>
Dec 06 14:09:00 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:00 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:00 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:00 user nova-compute[75326]:  {{(pid=75326) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-37c0c73d-1e78-4259-b3f1-bc74e1924c63 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.586s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updated VIF entry in instance network info cache for port a73d21ea-90ad-4f4a-8f63-8345cf69daea. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a48cf96-ac10-4767-b0a4-30c92939690f req-280ee49e-55cc-4115-a0de-2a0e437c0684 service nova] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG nova.objects.instance [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:01 user nova-compute[75326]: INFO nova.compute.manager [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Attaching volume 9d82bfac-9874-4bc6-a8e5-ae27d18030fd to /dev/vdb
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.utils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997912a-e60d-4b2b-8f17-5550ab53133d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[573fb322-6d07-4722-862d-951d0308e0dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ca0c6-9585-4b39-a2c9-5ad592e4126b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[299d0482-ea7c-4e44-be62-5f0a22d96c86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-changed-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Refreshing instance network info cache due to event network-changed-3bb531cd-ccf4-44a1-8f23-53474ef96150. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] Acquiring lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] Acquired lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Refreshing network info cache for port 3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:01 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b3f99-9d0b-4113-8844-b607e93669ae]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.utils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating existing volume attachment record: 01670c78-eb9e-4d2f-a04f-c626154019a2 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:01 user nova-compute[75326]: WARNING nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea for instance with vm_state active and task_state None.
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:01 user nova-compute[75326]: WARNING nova.compute.manager [req-0a2d51c8-465a-44f4-8cf5-d776e0878590 req-6f943810-feec-46f8-bab8-58faa093588a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea for instance with vm_state active and task_state None.
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lazy-loading 'flavor' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updated VIF entry in instance network info cache for port 3bb531cd-ccf4-44a1-8f23-53474ef96150. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updating instance_info_cache with network_info: [{"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9083374f-d293-44a7-b294-8cd7106c5fd1 req-119567d0-cf85-45e2-a278-6f7451525aa7 service nova] Releasing lock "refresh_cache-872abe6f-2e97-4ac4-98c3-fb52778e33ce" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:01 user nova-compute[75326]: INFO nova.compute.manager [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Attaching volume c8f9c68d-b495-41a2-824f-4c4df3a52969 to /dev/vdb
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.utils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc080a88-6a63-4acb-a82e-09da17930168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[784362a7-b907-44b6-814b-b18d8d4abb57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c43aeb-696b-477c-ab85-b1c8901129a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fe665f-ee48-468e-b636-3909e6f88e6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:01 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:09:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c6413-d2af-4e9a-96ed-c4e6353ffb27]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG os_brick.utils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:01 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updating existing volume attachment record: 1066cf07-3676-4b4a-9f0b-6164c35a0b51 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:09:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZywlDpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:06 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:06 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:06 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d65b83-67da-4b97-88c2-e1a133554167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:09:06 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a67f31-dc3a-4914-aa60-fb06cee02cb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9] added
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd1f6dc-0192-4b66-b41a-138087089037]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9f245-5206-4a58-99c5-599480af5874]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZywlDpO {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZywlDpO" returned: 0 in 0.035s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3c8f1-bc38-4a40-9dc7-547d878e785f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZywlDpO'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f0adc1-3788-49ac-9346-c745aa77c537]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ce72af-11e8-4ed1-9544-7095167ed528]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1619549-c6ed-4f19-ab49-c88e5a8e5bd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260]
Dec 06 14:09:06 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf35699-4b41-4ba7-9ab7-fcab1f29a579]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a96c6-bec1-4e8d-bbb3-04b7348b8aca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:06 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bebe19-e04a-45e1-aaf9-99bf524fb4ec]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZywlDpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lazy-loading 'flavor' on Instance uuid ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:06 user nova-compute[75326]: INFO nova.compute.manager [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Attaching volume bea3b7b6-f895-44d0-a2cc-aa9606f1d70a to /dev/sdc
Dec 06 14:09:06 user nova-compute[75326]: DEBUG os_brick.utils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe1b0e-40c9-4204-b49e-80a9767f87a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7477ec4-213c-4132-8c6f-28e902d1dbdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140659e-023c-4064-b95a-d40887a232ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94f2fa-1ddd-405b-bc06-c33544de085f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:07 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:09:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc255b46-b1f3-404b-9dcb-1e92b7c7528a]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.utils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updating existing volume attachment record: d842fcdb-eaec-4fbf-8d18-1aa27675f8c7 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23562666131336535', 'path': '/dev/sdg'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562666131336535', 'path': '/dev/sdg'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'flavor' on Instance uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:09:07 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:07 user nova-compute[75326]:   <source dev="/dev/sdg"/>
Dec 06 14:09:07 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:07 user nova-compute[75326]:   <serial>db8d78ef-e5c1-4da1-9fb3-136c8d42bad9</serial>
Dec 06 14:09:07 user nova-compute[75326]: </disk>
Dec 06 14:09:07 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:09:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No VIF found with MAC fa:16:3e:d9:25:d0, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:09:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WczsACYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:12 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcbb65b-38f7-48b4-9f1d-514a3a7c4d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:09:12 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddfc053-6809-4d68-aa54-4c79131240f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd] added
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2705f-7720-462d-8b5c-cdb7bd5f099c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cbfdbb-07c0-458e-86de-7776d34e0dd2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WczsACYE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WczsACYE" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6724a583-704c-4d43-8563-4b7f5aeaec6c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WczsACYE'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7137fb-d823-499c-9d25-e0458c950947]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f7d95-3cd1-4d5a-9823-d1b65e34d8af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d4b25-4153-470d-a946-c92d19785b30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260]
Dec 06 14:09:12 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c89c5704-f584-4880-9f6d-f47bdac1cb95 tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.715s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755caf7-0923-423a-90ff-1e1e697038af]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[053fb1e2-f0ed-41df-ad6a-fbcc14b9353d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:12 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2e65b-b019-4689-9a80-652e091d127f]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqTOfKAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WczsACYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23632343932323438', 'path': '/dev/sdh'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632343932323438', 'path': '/dev/sdh'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.291s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:13 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:09:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG nova.objects.instance [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2cfa19-7176-46c6-b809-958f547c9879]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:09:13 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:09:14 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:14 user nova-compute[75326]:   <source dev="/dev/sdh"/>
Dec 06 14:09:14 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:14 user nova-compute[75326]:   <serial>9d82bfac-9874-4bc6-a8e5-ae27d18030fd</serial>
Dec 06 14:09:14 user nova-compute[75326]: </disk>
Dec 06 14:09:14 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cc9582-6353-4190-b4b6-6f0dbad04b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969] added
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b244b1-8ea9-4368-ad8e-e5b752b9b3b2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd4d8a-ccef-45c2-a81c-075879669e21]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqTOfKAN {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqTOfKAN" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf88e7d-ac44-4aea-b556-3564a7adf524]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqTOfKAN'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd492e4-2d79-48b8-9440-9012b82c191b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12004889-834f-4486-b5df-4a339d897f1e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bcbd48-1eaf-4740-ba12-6ed8b0b61ed4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260]
Dec 06 14:09:14 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fef1b-032c-4f05-9b29-49685fc915f6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[68439a8c-ccaa-4b3c-9e14-eea518c599ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:14 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[289b8220-852b-431b-98d7-d6d96a29187c]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No BDM found with device name hda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] No VIF found with MAC fa:16:3e:b8:51:61, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:14 user nova-compute[75326]: INFO nova.compute.manager [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Detaching volume db8d78ef-e5c1-4da1-9fb3-136c8d42bad9
Dec 06 14:09:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-87fb0608-a4bb-4f95-8806-3dd86ebc1119 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.580s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:14 user nova-compute[75326]: INFO nova.virt.block_device [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Attempting to driver detach volume db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 from mountpoint /dev/vdb
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Attempting to detach device vdb from instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:14 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:14 user nova-compute[75326]:   <source dev="/dev/sdg"/>
Dec 06 14:09:14 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:14 user nova-compute[75326]:   <serial>db8d78ef-e5c1-4da1-9fb3-136c8d42bad9</serial>
Dec 06 14:09:14 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:09:14 user nova-compute[75326]: </disk>
Dec 06 14:09:14 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully detached device vdb from instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 from the persistent domain config.
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:14 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:14 user nova-compute[75326]:   <source dev="/dev/sdg"/>
Dec 06 14:09:14 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:14 user nova-compute[75326]:   <serial>db8d78ef-e5c1-4da1-9fb3-136c8d42bad9</serial>
Dec 06 14:09:14 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:09:14 user nova-compute[75326]: </disk>
Dec 06 14:09:14 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqTOfKAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '23834303330643165', 'path': '/dev/sdi'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834303330643165', 'path': '/dev/sdi'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lazy-loading 'flavor' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] attach device xml: <disk type="block" device="disk">
Dec 06 14:09:15 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:15 user nova-compute[75326]:   <source dev="/dev/sdi"/>
Dec 06 14:09:15 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:15 user nova-compute[75326]:   <serial>c8f9c68d-b495-41a2-824f-4c4df3a52969</serial>
Dec 06 14:09:15 user nova-compute[75326]: </disk>
Dec 06 14:09:15 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:15 user nova-compute[75326]: INFO nova.compute.manager [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Detaching volume 9d82bfac-9874-4bc6-a8e5-ae27d18030fd
Dec 06 14:09:15 user nova-compute[75326]: INFO nova.virt.block_device [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Attempting to driver detach volume 9d82bfac-9874-4bc6-a8e5-ae27d18030fd from mountpoint /dev/vdb
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Attempting to detach device vdb from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:15 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:15 user nova-compute[75326]:   <source dev="/dev/sdh"/>
Dec 06 14:09:15 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:15 user nova-compute[75326]:   <serial>9d82bfac-9874-4bc6-a8e5-ae27d18030fd</serial>
Dec 06 14:09:15 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:09:15 user nova-compute[75326]: </disk>
Dec 06 14:09:15 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully detached device vdb from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the persistent domain config.
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:15 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:15 user nova-compute[75326]:   <source dev="/dev/sdh"/>
Dec 06 14:09:15 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:15 user nova-compute[75326]:   <serial>9d82bfac-9874-4bc6-a8e5-ae27d18030fd</serial>
Dec 06 14:09:15 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:09:15 user nova-compute[75326]: </disk>
Dec 06 14:09:15 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] No VIF found with MAC fa:16:3e:78:d6:c2, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:09:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3a0277e-f396-4088-82af-8dfcc886d71e tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.169s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] volume_snapshot_create: create_info: {'snapshot_id': '394207b9-725c-4c38-9dd8-44e30bb32d32', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75326) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] snap xml: <domainsnapshot>
Dec 06 14:09:16 user nova-compute[75326]:   <disks>
Dec 06 14:09:16 user nova-compute[75326]:     <disk name="/dev/sdi" snapshot="external" type="file">
Dec 06 14:09:16 user nova-compute[75326]:       <source file="/dev/new_file"/>
Dec 06 14:09:16 user nova-compute[75326]:     </disk>
Dec 06 14:09:16 user nova-compute[75326]:     <disk name="vda" snapshot="no"/>
Dec 06 14:09:16 user nova-compute[75326]:   </disks>
Dec 06 14:09:16 user nova-compute[75326]: </domainsnapshot>
Dec 06 14:09:16 user nova-compute[75326]:  {{(pid=75326) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] Lazy-loading 'system_metadata' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     rv = execute(f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     six.reraise(c, e, tb)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     raise value
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     rv = meth(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     self._volume_snapshot_create(context, instance, guest,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     rv = execute(f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     six.reraise(c, e, tb)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     raise value
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     rv = meth(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] 
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-73ae2bc3-9b66-4e02-9cfe-517492e3a172 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] volume_snapshot_delete: delete_info: {'volume_id': 'c8f9c68d-b495-41a2-824f-4c4df3a52969'} {{(pid=75326) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [None req-73ae2bc3-9b66-4e02-9cfe-517492e3a172 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce]     if delete_info['type'] != 'qcow2':
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] KeyError: 'type'
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 394207b9-725c-4c38-9dd8-44e30bb32d32 could not be found.
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise value
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 394207b9-725c-4c38-9dd8-44e30bb32d32 could not be found. (HTTP 404) (Request-ID: req-3040399b-3ad9-4b01-870e-005960487d26)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 394207b9-725c-4c38-9dd8-44e30bb32d32 could not be found.
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server [None req-1b4fd01c-a76b-4854-8289-2a2c282d9ea0 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise value
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver [None req-73ae2bc3-9b66-4e02-9cfe-517492e3a172 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a23ca64a-8410-4001-8391-ed26164ace21)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 14:09:16 user nova-compute[75326]: ERROR nova.virt.libvirt.driver 
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server [None req-73ae2bc3-9b66-4e02-9cfe-517492e3a172 tempest-VolumesAssistedSnapshotsTest-1021147587 tempest-VolumesAssistedSnapshotsTest-1021147587-project] Exception during message handling: KeyError: 'type'
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 06 14:09:16 user nova-compute[75326]: ERROR oslo_messaging.rpc.server 
Dec 06 14:09:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:16 user nova-compute[75326]: INFO nova.compute.manager [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Detaching volume c8f9c68d-b495-41a2-824f-4c4df3a52969
Dec 06 14:09:16 user nova-compute[75326]: INFO nova.virt.block_device [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Attempting to driver detach volume c8f9c68d-b495-41a2-824f-4c4df3a52969 from mountpoint /dev/vdb
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Attempting to detach device vdb from instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:16 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:16 user nova-compute[75326]:   <source dev="/dev/sdi"/>
Dec 06 14:09:16 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:16 user nova-compute[75326]:   <serial>c8f9c68d-b495-41a2-824f-4c4df3a52969</serial>
Dec 06 14:09:16 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:09:16 user nova-compute[75326]: </disk>
Dec 06 14:09:16 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Successfully detached device vdb from instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce from the persistent domain config.
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:09:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:16 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:16 user nova-compute[75326]:   <source dev="/dev/sdi"/>
Dec 06 14:09:16 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:09:16 user nova-compute[75326]:   <serial>c8f9c68d-b495-41a2-824f-4c4df3a52969</serial>
Dec 06 14:09:16 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:09:16 user nova-compute[75326]: </disk>
Dec 06 14:09:16 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:09:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atocvqkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:18 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:18 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:18 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3939d-3885-48a5-bc07-7524747dc987]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:09:18 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9fba18-3d4f-402c-a8e3-37e1459fcb14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a] added
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8f4b6-8c35-48dc-8248-88d50a579c1d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[925c8394-34c1-4114-a216-d714c00b5814]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v atocvqkK {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v atocvqkK" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc3959-903e-4450-ad84-72deb07438a4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'atocvqkK'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70a606b-54c5-41db-b976-acbb6a6378ce]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d9979-c2a5-48c9-ad0f-bbcf2515877f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6bcf08-c3c3-466d-8e96-480028f1f5ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260]
Dec 06 14:09:18 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e074bda8-5716-4684-b1f0-2fec7de25cf9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf8107-d549-4f87-b201-efcf1a12feea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:18 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[42986c38-b125-421e-85f4-ccb8561eb766]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:18 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atocvqkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26265663136396238', 'path': '/dev/sdj'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663136396238', 'path': '/dev/sdj'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lazy-loading 'flavor' on Instance uuid ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:09:19 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:19 user nova-compute[75326]:   <source dev="/dev/sdj"/>
Dec 06 14:09:19 user nova-compute[75326]:   <target dev="sdc" bus="scsi"/>
Dec 06 14:09:19 user nova-compute[75326]:   <serial>bea3b7b6-f895-44d0-a2cc-aa9606f1d70a</serial>
Dec 06 14:09:19 user nova-compute[75326]:   <address type="drive" controller="0" unit="2"/>
Dec 06 14:09:19 user nova-compute[75326]: </disk>
Dec 06 14:09:19 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:09:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No BDM found with device name sda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:09:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] No VIF found with MAC fa:16:3e:22:29:8a, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:09:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b990c278-6cc9-4c31-a801-1b42f1dc81f7 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.653s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:21 user nova-compute[75326]: INFO nova.compute.manager [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Detaching volume bea3b7b6-f895-44d0-a2cc-aa9606f1d70a
Dec 06 14:09:21 user nova-compute[75326]: INFO nova.virt.block_device [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Attempting to driver detach volume bea3b7b6-f895-44d0-a2cc-aa9606f1d70a from mountpoint /dev/sdc
Dec 06 14:09:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Attempting to detach device sdc from instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:09:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:21 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:21 user nova-compute[75326]:   <source dev="/dev/sdj"/>
Dec 06 14:09:21 user nova-compute[75326]:   <target dev="sdc" bus="scsi"/>
Dec 06 14:09:21 user nova-compute[75326]:   <serial>bea3b7b6-f895-44d0-a2cc-aa9606f1d70a</serial>
Dec 06 14:09:21 user nova-compute[75326]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 14:09:21 user nova-compute[75326]: </disk>
Dec 06 14:09:21 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Successfully detached device sdc from instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d from the persistent domain config.
Dec 06 14:09:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:09:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:09:21 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:09:21 user nova-compute[75326]:   <source dev="/dev/sdj"/>
Dec 06 14:09:21 user nova-compute[75326]:   <target dev="sdc" bus="scsi"/>
Dec 06 14:09:21 user nova-compute[75326]:   <serial>bea3b7b6-f895-44d0-a2cc-aa9606f1d70a</serial>
Dec 06 14:09:21 user nova-compute[75326]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 14:09:21 user nova-compute[75326]: </disk>
Dec 06 14:09:21 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:09:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:09:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:09:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7250MB free_disk=25.58092498779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance be7c9178-71ea-4b1e-a926-e890d5efd218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 3b98f861-a8ff-4d36-a2f1-2414f51799cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 365e5848-c71d-4ecc-97f9-bd8b051c4a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 23c0e05a-eef8-4b0c-b15d-2263997734b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:09:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:28 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:09:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:09:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:09:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:35 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 is timed out.
Dec 06 14:09:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully detached device vdb from instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 from the live domain config.
Dec 06 14:09:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZywlDpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:35 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a052eb91-7144-4849-96a0-8bae3d29f2ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:35 user nova-compute[75326]: No targets found.
Dec 06 14:09:35 user nova-compute[75326]: iSNS:
Dec 06 14:09:35 user nova-compute[75326]: No targets found.
Dec 06 14:09:35 user nova-compute[75326]: STATIC:
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd
Dec 06 14:09:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:35 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:35 user nova-compute[75326]: No targets found.
Dec 06 14:09:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:35 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:35 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f31437-52ce-4829-b160-b76e86623887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50dd3d8-3d75-4081-b9f4-5a3416b380dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 (non-flash)
Dec 06 14:09:35 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc2d5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9'): ({'sdg'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Removing single pathed devices sdg {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ada5de-5c41-4cce-8f95-120dc2af26f0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22906766-3cbc-4212-9238-dadeb89599cf]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Flushing IO for device /dev/sdg {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79976550-1961-4fbd-a9cf-83dd2c1a4db1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb54bc-93cf-4603-96a0-1128eb8ca32b]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] SCSI volumes sdg have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ec6e00-9aa2-4254-af4d-1b01e80250bc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5efd908-0790-4018-814d-063ba4971e28]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260]
Dec 06 14:09:35 user nova-compute[75326]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8d78ef-e5c1-4da1-9fb3-136c8d42bad9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b9ca0-4081-4f23-b68f-0ae7fe2b6718]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] <== disconnect_volume: return (375ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:36 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb is timed out.
Dec 06 14:09:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully detached device vdb from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the live domain config.
Dec 06 14:09:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WczsACYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:36 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a2228e-3db1-415f-b60f-b98406da3209]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:36 user nova-compute[75326]: No targets found.
Dec 06 14:09:36 user nova-compute[75326]: iSNS:
Dec 06 14:09:36 user nova-compute[75326]: No targets found.
Dec 06 14:09:36 user nova-compute[75326]: STATIC:
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd
Dec 06 14:09:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:36 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:36 user nova-compute[75326]: No targets found.
Dec 06 14:09:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:36 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:36 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a68ad-e93a-432b-840f-aa96989ce1b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37da878-3aa5-4999-be88-70b2ac03a931]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:36 user nova-compute[75326]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd (non-flash)
Dec 06 14:09:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc2d56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd'): ({'sdh'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Removing single pathed devices sdh {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101b867-8663-4da8-bbe2-28e10be4145f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ca685-2bfb-4f4b-bf1d-721da84b4c31]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Flushing IO for device /dev/sdh {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'flavor' on Instance uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcdff03-1d66-4ec6-81db-634056643f98]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e799da81-26ac-43af-a6a3-4d1b7c43deed tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af2063-f9c4-436e-8a97-34c7e26ef50b]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] SCSI volumes sdh have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a7aa7-e6cb-41a9-9ace-810f2c2abf54]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9edef-cded-4212-8a4e-f49a040ad6f5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260]
Dec 06 14:09:36 user nova-compute[75326]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d82bfac-9874-4bc6-a8e5-ae27d18030fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccbc049-cd25-4aaf-a627-bc457cf42057]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] <== disconnect_volume: return (369ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:37 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce is timed out.
Dec 06 14:09:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Successfully detached device vdb from instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce from the live domain config.
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqTOfKAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff0e9c-c85f-4a4f-8cfc-e7c64e927043]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:37 user nova-compute[75326]: No targets found.
Dec 06 14:09:37 user nova-compute[75326]: iSNS:
Dec 06 14:09:37 user nova-compute[75326]: No targets found.
Dec 06 14:09:37 user nova-compute[75326]: STATIC:
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:37 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:37 user nova-compute[75326]: No targets found.
Dec 06 14:09:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:37 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:37 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac87975-ebb8-4c69-8a33-64ee6f773916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98b612-2d99-4468-a42d-cab6b19d35ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc2d6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969'): ({'sdi'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Removing single pathed devices sdi {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ee910e-5207-4827-921f-5ac6975d7289]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae233e45-4f04-495b-9cfc-0ecd92e8927f]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Flushing IO for device /dev/sdi {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d9eb2-bb9a-4cd6-9f7f-8a6eb3f8610a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.objects.instance [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e73cc1-bfb8-4bf8-a1f7-e63f2e0b2692]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] SCSI volumes sdi have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7138a5-8635-4baf-95b2-8e796a887abb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-596c812f-a9b0-473c-8ea8-d155e4158820 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73392de-5fc2-4d60-bfef-e30fe5f7e419]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260]
Dec 06 14:09:37 user nova-compute[75326]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f9c68d-b495-41a2-824f-4c4df3a52969 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa56ff-4ed3-4ec4-a160-8521a01fb666]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] <== disconnect_volume: return (334ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-changed-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing instance network info cache due to event network-changed-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] Acquiring lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] Acquired lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG nova.network.neutron [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Refreshing network info cache for port adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:09:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-a73d21ea-90ad-4f4a-8f63-8345cf69daea" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-a73d21ea-90ad-4f4a-8f63-8345cf69daea" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.network.neutron [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updated VIF entry in instance network info cache for port adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.network.neutron [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Attempting to detach device tapa73d21ea-90 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] detach device xml: <interface type="ethernet">
Dec 06 14:09:38 user nova-compute[75326]:   <mac address="fa:16:3e:91:8c:d7"/>
Dec 06 14:09:38 user nova-compute[75326]:   <model type="virtio"/>
Dec 06 14:09:38 user nova-compute[75326]:   <mtu size="1442"/>
Dec 06 14:09:38 user nova-compute[75326]:   <target dev="tapa73d21ea-90"/>
Dec 06 14:09:38 user nova-compute[75326]: </interface>
Dec 06 14:09:38 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8314bb0d-4c86-4004-a8e0-aadd96538c50 req-c3aa78f8-ebc0-40bc-863b-31c5cb5dc326 service nova] Releasing lock "refresh_cache-3b98f861-a8ff-4d36-a2f1-2414f51799cd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 06 14:09:38 user nova-compute[75326]:   <name>instance-00000007</name>
Dec 06 14:09:38 user nova-compute[75326]:   <uuid>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</uuid>
Dec 06 14:09:38 user nova-compute[75326]:   <metadata>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:38 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:00</nova:creationTime>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:38 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:38 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:38 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:38 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:38 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:38 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:38 user nova-compute[75326]:     <nova:port uuid="a73d21ea-90ad-4f4a-8f63-8345cf69daea">
Dec 06 14:09:38 user nova-compute[75326]:       <nova:ip type="fixed" address="10.10.10.190" ipVersion="4"/>
Dec 06 14:09:38 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:38 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:38 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:38 user nova-compute[75326]:   </metadata>
Dec 06 14:09:38 user nova-compute[75326]:   <memory unit='KiB'>524288</memory>
Dec 06 14:09:38 user nova-compute[75326]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 14:09:38 user nova-compute[75326]:   <vcpu placement='static'>1</vcpu>
Dec 06 14:09:38 user nova-compute[75326]:   <resource>
Dec 06 14:09:38 user nova-compute[75326]:     <partition>/machine</partition>
Dec 06 14:09:38 user nova-compute[75326]:   </resource>
Dec 06 14:09:38 user nova-compute[75326]:   <sysinfo type='smbios'>
Dec 06 14:09:38 user nova-compute[75326]:     <system>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='version'>0.0.0</entry>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='serial'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='uuid'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:38 user nova-compute[75326]:       <entry name='family'>Virtual Machine</entry>
Dec 06 14:09:38 user nova-compute[75326]:     </system>
Dec 06 14:09:38 user nova-compute[75326]:   </sysinfo>
Dec 06 14:09:38 user nova-compute[75326]:   <os>
Dec 06 14:09:38 user nova-compute[75326]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 14:09:38 user nova-compute[75326]:     <boot dev='hd'/>
Dec 06 14:09:38 user nova-compute[75326]:     <smbios mode='sysinfo'/>
Dec 06 14:09:38 user nova-compute[75326]:   </os>
Dec 06 14:09:38 user nova-compute[75326]:   <features>
Dec 06 14:09:38 user nova-compute[75326]:     <acpi/>
Dec 06 14:09:38 user nova-compute[75326]:     <apic/>
Dec 06 14:09:38 user nova-compute[75326]:     <vmcoreinfo state='on'/>
Dec 06 14:09:38 user nova-compute[75326]:   </features>
Dec 06 14:09:38 user nova-compute[75326]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 14:09:38 user nova-compute[75326]:     <model fallback='forbid'>Nehalem</model>
Dec 06 14:09:38 user nova-compute[75326]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 14:09:38 user nova-compute[75326]:     <feature policy='require' name='vme'/>
Dec 06 14:09:38 user nova-compute[75326]:     <feature policy='require' name='x2apic'/>
Dec 06 14:09:38 user nova-compute[75326]:     <feature policy='require' name='hypervisor'/>
Dec 06 14:09:38 user nova-compute[75326]:   </cpu>
Dec 06 14:09:38 user nova-compute[75326]:   <clock offset='utc'>
Dec 06 14:09:38 user nova-compute[75326]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 14:09:38 user nova-compute[75326]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 14:09:38 user nova-compute[75326]:     <timer name='hpet' present='no'/>
Dec 06 14:09:38 user nova-compute[75326]:   </clock>
Dec 06 14:09:38 user nova-compute[75326]:   <on_poweroff>destroy</on_poweroff>
Dec 06 14:09:38 user nova-compute[75326]:   <on_reboot>restart</on_reboot>
Dec 06 14:09:38 user nova-compute[75326]:   <on_crash>destroy</on_crash>
Dec 06 14:09:38 user nova-compute[75326]:   <devices>
Dec 06 14:09:38 user nova-compute[75326]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 14:09:38 user nova-compute[75326]:     <disk type='file' device='disk'>
Dec 06 14:09:38 user nova-compute[75326]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 14:09:38 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk' index='2'/>
Dec 06 14:09:38 user nova-compute[75326]:       <backingStore type='file' index='3'>
Dec 06 14:09:38 user nova-compute[75326]:         <format type='raw'/>
Dec 06 14:09:38 user nova-compute[75326]:         <source file='/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576'/>
Dec 06 14:09:38 user nova-compute[75326]:         <backingStore/>
Dec 06 14:09:38 user nova-compute[75326]:       </backingStore>
Dec 06 14:09:38 user nova-compute[75326]:       <target dev='vda' bus='virtio'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='virtio-disk0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </disk>
Dec 06 14:09:38 user nova-compute[75326]:     <disk type='file' device='cdrom'>
Dec 06 14:09:38 user nova-compute[75326]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 14:09:38 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config' index='1'/>
Dec 06 14:09:38 user nova-compute[75326]:       <backingStore/>
Dec 06 14:09:38 user nova-compute[75326]:       <target dev='hda' bus='ide'/>
Dec 06 14:09:38 user nova-compute[75326]:       <readonly/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='ide0-0-0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </disk>
Dec 06 14:09:38 user nova-compute[75326]:     <controller type='usb' index='0' model='none'>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='usb'/>
Dec 06 14:09:38 user nova-compute[75326]:     </controller>
Dec 06 14:09:38 user nova-compute[75326]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='pci.0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </controller>
Dec 06 14:09:38 user nova-compute[75326]:     <controller type='ide' index='0'>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='ide'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 14:09:38 user nova-compute[75326]:     </controller>
Dec 06 14:09:38 user nova-compute[75326]:     <interface type='ethernet'>
Dec 06 14:09:38 user nova-compute[75326]:       <mac address='fa:16:3e:b8:51:61'/>
Dec 06 14:09:38 user nova-compute[75326]:       <target dev='tapf686132b-b2'/>
Dec 06 14:09:38 user nova-compute[75326]:       <model type='virtio'/>
Dec 06 14:09:38 user nova-compute[75326]:       <mtu size='1442'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='net0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </interface>
Dec 06 14:09:38 user nova-compute[75326]:     <interface type='ethernet'>
Dec 06 14:09:38 user nova-compute[75326]:       <mac address='fa:16:3e:91:8c:d7'/>
Dec 06 14:09:38 user nova-compute[75326]:       <target dev='tapa73d21ea-90'/>
Dec 06 14:09:38 user nova-compute[75326]:       <model type='virtio'/>
Dec 06 14:09:38 user nova-compute[75326]:       <mtu size='1442'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='net1'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </interface>
Dec 06 14:09:38 user nova-compute[75326]:     <serial type='pty'>
Dec 06 14:09:38 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:38 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:38 user nova-compute[75326]:       <target type='isa-serial' port='0'>
Dec 06 14:09:38 user nova-compute[75326]:         <model name='isa-serial'/>
Dec 06 14:09:38 user nova-compute[75326]:       </target>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </serial>
Dec 06 14:09:38 user nova-compute[75326]:     <console type='pty' tty='/dev/pts/6'>
Dec 06 14:09:38 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:38 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:38 user nova-compute[75326]:       <target type='serial' port='0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </console>
Dec 06 14:09:38 user nova-compute[75326]:     <input type='mouse' bus='ps2'>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='input0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </input>
Dec 06 14:09:38 user nova-compute[75326]:     <input type='keyboard' bus='ps2'>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='input1'/>
Dec 06 14:09:38 user nova-compute[75326]:     </input>
Dec 06 14:09:38 user nova-compute[75326]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 06 14:09:38 user nova-compute[75326]:       <listen type='address' address='0.0.0.0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </graphics>
Dec 06 14:09:38 user nova-compute[75326]:     <audio id='1' type='none'/>
Dec 06 14:09:38 user nova-compute[75326]:     <video>
Dec 06 14:09:38 user nova-compute[75326]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='video0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </video>
Dec 06 14:09:38 user nova-compute[75326]:     <memballoon model='virtio'>
Dec 06 14:09:38 user nova-compute[75326]:       <stats period='10'/>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='balloon0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </memballoon>
Dec 06 14:09:38 user nova-compute[75326]:     <rng model='virtio'>
Dec 06 14:09:38 user nova-compute[75326]:       <backend model='random'>/dev/urandom</backend>
Dec 06 14:09:38 user nova-compute[75326]:       <alias name='rng0'/>
Dec 06 14:09:38 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 14:09:38 user nova-compute[75326]:     </rng>
Dec 06 14:09:38 user nova-compute[75326]:   </devices>
Dec 06 14:09:38 user nova-compute[75326]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 14:09:38 user nova-compute[75326]:     <label>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</label>
Dec 06 14:09:38 user nova-compute[75326]:     <imagelabel>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</imagelabel>
Dec 06 14:09:38 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:38 user nova-compute[75326]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 14:09:38 user nova-compute[75326]:     <label>+64055:+108</label>
Dec 06 14:09:38 user nova-compute[75326]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 14:09:38 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:38 user nova-compute[75326]: </domain>
Dec 06 14:09:38 user nova-compute[75326]:  {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 14:09:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully detached device tapa73d21ea-90 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the persistent domain config.
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] (1/8): Attempting to detach device tapa73d21ea-90 with device alias net1 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] detach device xml: <interface type="ethernet">
Dec 06 14:09:38 user nova-compute[75326]:   <mac address="fa:16:3e:91:8c:d7"/>
Dec 06 14:09:38 user nova-compute[75326]:   <model type="virtio"/>
Dec 06 14:09:38 user nova-compute[75326]:   <mtu size="1442"/>
Dec 06 14:09:38 user nova-compute[75326]:   <target dev="tapa73d21ea-90"/>
Dec 06 14:09:38 user nova-compute[75326]: </interface>
Dec 06 14:09:38 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lazy-loading 'flavor' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bbf3df39-a9a8-49ec-a860-87cc63b26123 tempest-VolumesAssistedSnapshotsTest-475537540 tempest-VolumesAssistedSnapshotsTest-475537540-project-admin] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Start waiting for the detach event from libvirt for device tapa73d21ea-90 with device alias net1 for instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-unplugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-unplugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:39 user nova-compute[75326]: WARNING nova.compute.manager [req-08959b10-1c78-45ca-9944-a7e8cceef2f9 req-efefd173-cc49-42b0-b07d-d43b4de4a9ff service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-unplugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea for instance with vm_state active and task_state None.
Dec 06 14:09:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:40 user nova-compute[75326]: INFO nova.compute.manager [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Terminating instance
Dec 06 14:09:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-161546af-72d7-458d-819d-7ba748d1b041 req-a5003aea-515e-4c32-8581-27c1ef12cd39 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:41 user nova-compute[75326]: WARNING nova.compute.manager [req-ac46ec11-d259-42fa-9b48-9faf1809ec4c req-f7294dac-ff33-40e3-894a-1be92c2ace8f service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-a73d21ea-90ad-4f4a-8f63-8345cf69daea for instance with vm_state active and task_state None.
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-60934545-a890-4bb4-bdec-0fe605ad52d3 req-1dcf896f-03c8-4101-8a4c-5e0b06481dbb service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d is timed out.
Dec 06 14:09:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Successfully detached device sdc from instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d from the live domain config.
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atocvqkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9bf09-5a99-449b-93a9-4302723ab362]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:42 user nova-compute[75326]: No targets found.
Dec 06 14:09:42 user nova-compute[75326]: iSNS:
Dec 06 14:09:42 user nova-compute[75326]: No targets found.
Dec 06 14:09:42 user nova-compute[75326]: STATIC:
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:42 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:42 user nova-compute[75326]: No targets found.
Dec 06 14:09:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:42 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:42 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dbb9ec-533a-4712-a399-0c9401ec6299]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6a180-820b-4212-aa09-a5f5060e700e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:42 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44825f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a'): ({'sdj'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Removing single pathed devices sdj {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63f0a2-d750-49d0-b129-0cfee1eacc39]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd75515-0777-4406-afe8-6bcd5cacfedd]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Flushing IO for device /dev/sdj {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc086a3f-b127-4b63-b781-b069c6315674]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.093s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c4993-5080-4a14-9eb3-c701facc4811]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] SCSI volumes sdj have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_863617be',) {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:09:42 user nova-compute[75326]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_863617be
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0e458-3fcf-4140-ae48-b9f796319fb0]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f033fa-a6a9-49a1-bdab-ee5b454fca80]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee579efb-3788-45d6-bcb0-b320737c6bdd]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260]
Dec 06 14:09:42 user nova-compute[75326]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea3b7b6-f895-44d0-a2cc-aa9606f1d70a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad71be-6e31-4973-9d46-c2b66d84a5d6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] <== disconnect_volume: return (466ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Instance destroyed successfully.
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lazy-loading 'resources' on Instance uuid 3b98f861-a8ff-4d36-a2f1-2414f51799cd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadbfe9f3-4f, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe24bbd6-27f2-46bc-a2fa-98bc33d896d0) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:61,bridge_name='br-int',has_traffic_filtering=True,id=adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e,network=Network(21396ddb-1296-423d-a2ce-a6f6fc7c6268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadbfe9f3-4f')
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d88babf-32, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa12d6d6-55d2-4529-a0cc-dcd1fbc7347f) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:37:07,bridge_name='br-int',has_traffic_filtering=True,id=1d88babf-3247-42e7-8dd8-c9d5d1d5cacd,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d88babf-32')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cc9805d-3b, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2609e69a-9a12-47ce-b98a-b1b02b06bf91) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1d88babf-3247-42e7-8dd8-c9d5d1d5cacd for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-168aa491-0a1a-4489-8b9a-14280f407b3a req-2746bc62-f16f-4564-b8f7-afd310bb83bf service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-5bd70e39-2afd-42a8-a1b5-1183e42962a2 for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:f6,bridge_name='br-int',has_traffic_filtering=True,id=3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cc9805d-3b')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96250c6f-ee, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=196ded1e-5aa7-4dd8-ae38-dc20e188a290) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=96250c6f-ee4e-40aa-8188-31512e195aff,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96250c6f-ee')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1227972a-52, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-1227972a-5226-4d99-bf55-12aad4816f0f for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-1227972a-5226-4d99-bf55-12aad4816f0f for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-d36702ef-b06c-4a14-a002-facf951c2bd6 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-49cf4e15-2dc2-4df6-b4d1-16b381f57d9e req-b1e3bc9e-06ef-4de4-b067-7657df0c8661 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-d36702ef-b06c-4a14-a002-facf951c2bd6 for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60c3719e-ee70-4c26-8c7a-43e9d82eeb0e) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5d:fb,bridge_name='br-int',has_traffic_filtering=True,id=1227972a-5226-4d99-bf55-12aad4816f0f,network=Network(05dd5e2b-889c-4075-a020-4a42b34427ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1227972a-52')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd70e39-2a, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5 for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-unplugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-unplugged-96250c6f-ee4e-40aa-8188-31512e195aff for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Acquiring lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] No waiting events found dispatching network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING nova.compute.manager [req-0537f506-380f-46b8-93ff-3a3d4a8e779a req-9444679c-f6fe-4bfb-8074-9d7e0356b25e service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received unexpected event network-vif-plugged-96250c6f-ee4e-40aa-8188-31512e195aff for instance with vm_state active and task_state deleting.
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27c558fe-81b6-410f-9e89-7e32bb12eac8) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lazy-loading 'flavor' on Instance uuid ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:eb:de,bridge_name='br-int',has_traffic_filtering=True,id=5bd70e39-2afd-42a8-a1b5-1183e42962a2,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd70e39-2a')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550594306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550594306',id=10,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIClYX62dzLDG3pgIzU/U7v1XiSwgVlLonuNdqiHU38SROiL4qX0U4IkyLSfk+hiZgwwbFZa4FtWzCCYuyk+HYZ9on5u1iS3wZOGukOSLaYs58+bzKoV7X+JlGsz3C9Rw==',key_name='tempest-keypair-1186696810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f98481dd6b46f7b5c0dba03e86b557',ramdisk_id='',reservation_id='r-i6v981e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-56872621',owner_user_name='tempest-TaggedBootDevicesTest-56872621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94402c2e73184ad5ae812092d832c022',uuid=3b98f861-a8ff-4d36-a2f1-2414f51799cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converting VIF {"id": "d36702ef-b06c-4a14-a002-facf951c2bd6", "address": "fa:16:3e:cf:8a:7a", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36702ef-b0", "ovs_interfaceid": "d36702ef-b06c-4a14-a002-facf951c2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd36702ef-b0, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-21ecb5ff-372f-4829-bac1-1b3a5556d068 tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bd2100d-a46f-44cc-81a5-da3d3fb1beb2) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:43 user nova-compute[75326]: INFO os_vif [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8a:7a,bridge_name='br-int',has_traffic_filtering=True,id=d36702ef-b06c-4a14-a002-facf951c2bd6,network=Network(dd094dea-f1cd-40e2-8cd5-7e8e0259aa13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36702ef-b0')
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDCTLfUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b923c-a0f7-42bf-a755-e9bd30bbe69e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]: iSNS:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]: STATIC:
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:43 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:43 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde2f041-a0d5-4f78-b4f0-67538094c42f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[27178c63-d2c3-4364-904a-316db17af681]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf3dcf-e7f1-4438-976c-5446a5268eb1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e7818-a184-4891-9122-58a9a0b33b2a]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeff5e7-d77d-4d21-9982-3276d2cb5823]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6f673-3621-4248-b110-2bb917a1a6e0]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[78add910-5afe-47dd-8800-1d939513d107]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5544376-bfcd-46af-95ff-63802ef0daea]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260]
Dec 06 14:09:43 user nova-compute[75326]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb1f481-a136-4291-98bf-22f763853687 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a77748-9370-4d32-b8e4-dc6235001039]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== disconnect_volume: return (303ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNGBWDfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:43 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fae1e0-cfa2-44a7-ba7a-63cd65e9eb68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]: iSNS:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]: STATIC:
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a
Dec 06 14:09:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:43 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:43 user nova-compute[75326]: No targets found.
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:43 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:43 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea250cdb-8cd1-4df0-a9d9-209991eda6a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695b4fc-a495-45c4-bc08-a89b6e1cacef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:43 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c71a3-df09-4ffb-afb7-d0c3b28c0de5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e033f0a-87bd-422e-9426-ee1d2877cc00]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc8cf4-51cc-4523-b660-4a7a0be4aa8f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1fcf54-607a-4701-8fe4-76a500480684]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e13f5f4-5aff-4b5d-a269-1e89c337baab]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff320b-74dd-4bbd-b538-8e42981b34d1]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260]
Dec 06 14:09:44 user nova-compute[75326]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77189d4a-2ff6-4b88-a158-23a5ddddc07a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dec8f9-ddbd-464c-8385-86c0d513aac9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== disconnect_volume: return (303ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNDsmQgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:44 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[007d7383-d4a2-443e-804a-4344a7a35328]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:09:44 user nova-compute[75326]: No targets found.
Dec 06 14:09:44 user nova-compute[75326]: iSNS:
Dec 06 14:09:44 user nova-compute[75326]: No targets found.
Dec 06 14:09:44 user nova-compute[75326]: STATIC:
Dec 06 14:09:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:09:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:09:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e
Dec 06 14:09:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:09:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:09:44 user nova-compute[75326]: FIRMWARE:
Dec 06 14:09:44 user nova-compute[75326]: No targets found.
Dec 06 14:09:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:09:44 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:09:44 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c152f3-3960-4e57-a968-61968383b935]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0e384-c786-4bd5-9b9c-415109616009]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:44 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e (non-flash)
Dec 06 14:09:44 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:09:44 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:09:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f5939f-1c5f-4d4c-8058-143f6e5589b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5898cc8c-be6b-4e22-aab8-44246a45926a]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff836c-3435-4746-8c96-ebf5f2bac09d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de84c39-ff0a-4630-b9b6-5a6820998d9b]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65636830-f773-4cad-a9bb-7ef05b1b2210]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fde8a9-342c-400d-b661-f11e6bca6647]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260]
Dec 06 14:09:44 user nova-compute[75326]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e, portal: 172.16.0.220,3260] successful.
Dec 06 14:09:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116afbe-deca-42c8-b710-a97a2790d79e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01e5cbe-928d-49d0-a35e-42ec5a6d7973]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] <== disconnect_volume: return (284ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:09:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Deleting instance files /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd_del
Dec 06 14:09:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Deletion of /opt/stack/data/nova/instances/3b98f861-a8ff-4d36-a2f1-2414f51799cd_del complete
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:44 user nova-compute[75326]: INFO nova.compute.manager [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Terminating instance
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:09:44 user nova-compute[75326]: INFO nova.compute.manager [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Took 3.78 seconds to destroy the instance on the hypervisor.
Dec 06 14:09:44 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-unplugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] No waiting events found dispatching network-vif-unplugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-2f4a5219-daa1-42eb-99fe-0ad3f94ae017 req-00c079bf-9584-4fd2-a4c5-1e42334ee94e service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-unplugged-5a557284-877d-4b20-9636-c231962e9aaa for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:09:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Instance destroyed successfully.
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lazy-loading 'resources' on Instance uuid ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-469026386',display_name='tempest-AttachSCSIVolumeTestJSON-server-469026386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-469026386',id=8,image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrFGVnXAMiY84wdPap15hf3O29EGjJ+WRoG3vqHiMlFt/OUc2K8Ic6QjUmaZn3BaL8T4XbKRPBRVps2NGhw3OSPMbsB6gXoimxR2f6cY81Fj58w1O2S9HlaoLhcDi1y7g==',key_name='tempest-keypair-1131004893',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bce7330aa3e4bce8640074c19670f81',ramdisk_id='',reservation_id='r-ro3wgh7f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b5d02b36-faaf-4b99-bbe1-90d4205d44b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269260849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269260849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dae5bf486abc4c4ca58c2bf7f602d3dc',uuid=ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converting VIF {"id": "5a557284-877d-4b20-9636-c231962e9aaa", "address": "fa:16:3e:22:29:8a", "network": {"id": "45bfa276-3bd9-4208-a9e0-49802fde7664", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-675744233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bce7330aa3e4bce8640074c19670f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a557284-87", "ovs_interfaceid": "5a557284-877d-4b20-9636-c231962e9aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG os_vif [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a557284-87, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a1b4818-c47f-4137-973f-5450cb8e92aa) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:45 user nova-compute[75326]: INFO os_vif [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:8a,bridge_name='br-int',has_traffic_filtering=True,id=5a557284-877d-4b20-9636-c231962e9aaa,network=Network(45bfa276-3bd9-4208-a9e0-49802fde7664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a557284-87')
Dec 06 14:09:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Deleting instance files /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d_del
Dec 06 14:09:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Deletion of /opt/stack/data/nova/instances/ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d_del complete
Dec 06 14:09:45 user nova-compute[75326]: INFO nova.compute.manager [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 06 14:09:45 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:09:45 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:09:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] Acquiring lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] No waiting events found dispatching network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:09:47 user nova-compute[75326]: WARNING nova.compute.manager [req-cebad12b-5210-4bfc-9e1d-fb62fb5f5ce5 req-a5cea738-3f38-4236-bc03-bb783be35711 service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received unexpected event network-vif-plugged-5a557284-877d-4b20-9636-c231962e9aaa for instance with vm_state active and task_state deleting.
Dec 06 14:09:47 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:47 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Took 2.30 seconds to deallocate network for instance.
Dec 06 14:09:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:48 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:09:48 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:09:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:48 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Deleted allocations for instance ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d
Dec 06 14:09:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7a51885a-8c41-4e93-8940-bdb41b9f4e4f tempest-AttachSCSIVolumeTestJSON-1269260849 tempest-AttachSCSIVolumeTestJSON-1269260849-project-member] Lock "ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.894s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: ab52ff81-fbf5-4b10-8eb6-a62a1e5c034d] Received event network-vif-deleted-5a557284-877d-4b20-9636-c231962e9aaa {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-deleted-d36702ef-b06c-4a14-a002-facf951c2bd6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:49 user nova-compute[75326]: INFO nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Neutron deleted interface d36702ef-b06c-4a14-a002-facf951c2bd6; detaching it from the instance and deleting it from the info cache
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96250c6f-ee4e-40aa-8188-31512e195aff", "address": "fa:16:3e:2e:8e:a5", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96250c6f-ee", "ovs_interfaceid": "96250c6f-ee4e-40aa-8188-31512e195aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Detach interface failed, port_id=d36702ef-b06c-4a14-a002-facf951c2bd6, reason: Instance 3b98f861-a8ff-4d36-a2f1-2414f51799cd could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-deleted-96250c6f-ee4e-40aa-8188-31512e195aff {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:49 user nova-compute[75326]: INFO nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Neutron deleted interface 96250c6f-ee4e-40aa-8188-31512e195aff; detaching it from the instance and deleting it from the info cache
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [{"id": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "address": "fa:16:3e:e5:a0:61", "network": {"id": "21396ddb-1296-423d-a2ce-a6f6fc7c6268", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1035606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadbfe9f3-4f", "ovs_interfaceid": "adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "address": "fa:16:3e:92:37:07", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d88babf-32", "ovs_interfaceid": "1d88babf-3247-42e7-8dd8-c9d5d1d5cacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "address": "fa:16:3e:27:9d:f6", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc9805d-3b", "ovs_interfaceid": "3cc9805d-3b6a-4f9c-b3b6-2f0a0f711ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1227972a-5226-4d99-bf55-12aad4816f0f", "address": "fa:16:3e:bf:5d:fb", "network": {"id": "05dd5e2b-889c-4075-a020-4a42b34427ff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1691922271", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1227972a-52", "ovs_interfaceid": "1227972a-5226-4d99-bf55-12aad4816f0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "address": "fa:16:3e:2e:eb:de", "network": {"id": "dd094dea-f1cd-40e2-8cd5-7e8e0259aa13", "bridge": "br-int", "label": "tempest-device-tagging-net2-996874836", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94f98481dd6b46f7b5c0dba03e86b557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd70e39-2a", "ovs_interfaceid": "5bd70e39-2afd-42a8-a1b5-1183e42962a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b049353-3304-42bb-a25e-afa4c3cf247b req-0eace332-9c32-4dd9-b26f-c71d9818a7cc service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Detach interface failed, port_id=96250c6f-ee4e-40aa-8188-31512e195aff, reason: Instance 3b98f861-a8ff-4d36-a2f1-2414f51799cd could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:09:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:50 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:50 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Took 6.08 seconds to deallocate network for instance.
Dec 06 14:09:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-b21c504b-0290-4000-a530-93fbc961a773 req-231eef2a-6244-4b4f-8b3f-76b6a6898417 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-deleted-adbfe9f3-4fe1-4dd3-b611-8f6debb56d1e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-b21c504b-0290-4000-a530-93fbc961a773 req-231eef2a-6244-4b4f-8b3f-76b6a6898417 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-deleted-5bd70e39-2afd-42a8-a1b5-1183e42962a2 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-b21c504b-0290-4000-a530-93fbc961a773 req-231eef2a-6244-4b4f-8b3f-76b6a6898417 service nova] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Received event network-vif-deleted-1227972a-5226-4d99-bf55-12aad4816f0f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:53 user nova-compute[75326]: INFO nova.compute.manager [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] [instance: 3b98f861-a8ff-4d36-a2f1-2414f51799cd] Took 2.47 seconds to detach 3 volumes for instance.
Dec 06 14:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:53 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:09:53 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:53 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Deleted allocations for instance 3b98f861-a8ff-4d36-a2f1-2414f51799cd
Dec 06 14:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f7fdaf1d-baa2-42c8-8e5a-8fc8a55c9b39 tempest-TaggedBootDevicesTest-56872621 tempest-TaggedBootDevicesTest-56872621-project-member] Lock "3b98f861-a8ff-4d36-a2f1-2414f51799cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.917s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:09:58 user nova-compute[75326]: INFO nova.compute.claims [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Claim successful on node user
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:09:58 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Waiting for libvirt event about the detach of device tapa73d21ea-90 with device alias net1 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb is timed out.
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 06 14:09:58 user nova-compute[75326]:   <name>instance-00000007</name>
Dec 06 14:09:58 user nova-compute[75326]:   <uuid>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</uuid>
Dec 06 14:09:58 user nova-compute[75326]:   <metadata>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:58 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:00</nova:creationTime>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:58 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:58 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:58 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:port uuid="a73d21ea-90ad-4f4a-8f63-8345cf69daea">
Dec 06 14:09:58 user nova-compute[75326]:       <nova:ip type="fixed" address="10.10.10.190" ipVersion="4"/>
Dec 06 14:09:58 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:58 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:58 user nova-compute[75326]:   </metadata>
Dec 06 14:09:58 user nova-compute[75326]:   <memory unit='KiB'>524288</memory>
Dec 06 14:09:58 user nova-compute[75326]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 14:09:58 user nova-compute[75326]:   <vcpu placement='static'>1</vcpu>
Dec 06 14:09:58 user nova-compute[75326]:   <resource>
Dec 06 14:09:58 user nova-compute[75326]:     <partition>/machine</partition>
Dec 06 14:09:58 user nova-compute[75326]:   </resource>
Dec 06 14:09:58 user nova-compute[75326]:   <sysinfo type='smbios'>
Dec 06 14:09:58 user nova-compute[75326]:     <system>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='version'>0.0.0</entry>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='serial'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='uuid'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:58 user nova-compute[75326]:       <entry name='family'>Virtual Machine</entry>
Dec 06 14:09:58 user nova-compute[75326]:     </system>
Dec 06 14:09:58 user nova-compute[75326]:   </sysinfo>
Dec 06 14:09:58 user nova-compute[75326]:   <os>
Dec 06 14:09:58 user nova-compute[75326]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 14:09:58 user nova-compute[75326]:     <boot dev='hd'/>
Dec 06 14:09:58 user nova-compute[75326]:     <smbios mode='sysinfo'/>
Dec 06 14:09:58 user nova-compute[75326]:   </os>
Dec 06 14:09:58 user nova-compute[75326]:   <features>
Dec 06 14:09:58 user nova-compute[75326]:     <acpi/>
Dec 06 14:09:58 user nova-compute[75326]:     <apic/>
Dec 06 14:09:58 user nova-compute[75326]:     <vmcoreinfo state='on'/>
Dec 06 14:09:58 user nova-compute[75326]:   </features>
Dec 06 14:09:58 user nova-compute[75326]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 14:09:58 user nova-compute[75326]:     <model fallback='forbid'>Nehalem</model>
Dec 06 14:09:58 user nova-compute[75326]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 14:09:58 user nova-compute[75326]:     <feature policy='require' name='vme'/>
Dec 06 14:09:58 user nova-compute[75326]:     <feature policy='require' name='x2apic'/>
Dec 06 14:09:58 user nova-compute[75326]:     <feature policy='require' name='hypervisor'/>
Dec 06 14:09:58 user nova-compute[75326]:   </cpu>
Dec 06 14:09:58 user nova-compute[75326]:   <clock offset='utc'>
Dec 06 14:09:58 user nova-compute[75326]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 14:09:58 user nova-compute[75326]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 14:09:58 user nova-compute[75326]:     <timer name='hpet' present='no'/>
Dec 06 14:09:58 user nova-compute[75326]:   </clock>
Dec 06 14:09:58 user nova-compute[75326]:   <on_poweroff>destroy</on_poweroff>
Dec 06 14:09:58 user nova-compute[75326]:   <on_reboot>restart</on_reboot>
Dec 06 14:09:58 user nova-compute[75326]:   <on_crash>destroy</on_crash>
Dec 06 14:09:58 user nova-compute[75326]:   <devices>
Dec 06 14:09:58 user nova-compute[75326]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 14:09:58 user nova-compute[75326]:     <disk type='file' device='disk'>
Dec 06 14:09:58 user nova-compute[75326]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 14:09:58 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk' index='2'/>
Dec 06 14:09:58 user nova-compute[75326]:       <backingStore type='file' index='3'>
Dec 06 14:09:58 user nova-compute[75326]:         <format type='raw'/>
Dec 06 14:09:58 user nova-compute[75326]:         <source file='/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576'/>
Dec 06 14:09:58 user nova-compute[75326]:         <backingStore/>
Dec 06 14:09:58 user nova-compute[75326]:       </backingStore>
Dec 06 14:09:58 user nova-compute[75326]:       <target dev='vda' bus='virtio'/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='virtio-disk0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </disk>
Dec 06 14:09:58 user nova-compute[75326]:     <disk type='file' device='cdrom'>
Dec 06 14:09:58 user nova-compute[75326]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 14:09:58 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config' index='1'/>
Dec 06 14:09:58 user nova-compute[75326]:       <backingStore/>
Dec 06 14:09:58 user nova-compute[75326]:       <target dev='hda' bus='ide'/>
Dec 06 14:09:58 user nova-compute[75326]:       <readonly/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='ide0-0-0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </disk>
Dec 06 14:09:58 user nova-compute[75326]:     <controller type='usb' index='0' model='none'>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='usb'/>
Dec 06 14:09:58 user nova-compute[75326]:     </controller>
Dec 06 14:09:58 user nova-compute[75326]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='pci.0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </controller>
Dec 06 14:09:58 user nova-compute[75326]:     <controller type='ide' index='0'>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='ide'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 14:09:58 user nova-compute[75326]:     </controller>
Dec 06 14:09:58 user nova-compute[75326]:     <interface type='ethernet'>
Dec 06 14:09:58 user nova-compute[75326]:       <mac address='fa:16:3e:b8:51:61'/>
Dec 06 14:09:58 user nova-compute[75326]:       <target dev='tapf686132b-b2'/>
Dec 06 14:09:58 user nova-compute[75326]:       <model type='virtio'/>
Dec 06 14:09:58 user nova-compute[75326]:       <mtu size='1442'/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='net0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </interface>
Dec 06 14:09:58 user nova-compute[75326]:     <serial type='pty'>
Dec 06 14:09:58 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:58 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:58 user nova-compute[75326]:       <target type='isa-serial' port='0'>
Dec 06 14:09:58 user nova-compute[75326]:         <model name='isa-serial'/>
Dec 06 14:09:58 user nova-compute[75326]:       </target>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </serial>
Dec 06 14:09:58 user nova-compute[75326]:     <console type='pty' tty='/dev/pts/6'>
Dec 06 14:09:58 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:58 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:58 user nova-compute[75326]:       <target type='serial' port='0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </console>
Dec 06 14:09:58 user nova-compute[75326]:     <input type='mouse' bus='ps2'>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='input0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </input>
Dec 06 14:09:58 user nova-compute[75326]:     <input type='keyboard' bus='ps2'>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='input1'/>
Dec 06 14:09:58 user nova-compute[75326]:     </input>
Dec 06 14:09:58 user nova-compute[75326]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 06 14:09:58 user nova-compute[75326]:       <listen type='address' address='0.0.0.0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </graphics>
Dec 06 14:09:58 user nova-compute[75326]:     <audio id='1' type='none'/>
Dec 06 14:09:58 user nova-compute[75326]:     <video>
Dec 06 14:09:58 user nova-compute[75326]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='video0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </video>
Dec 06 14:09:58 user nova-compute[75326]:     <memballoon model='virtio'>
Dec 06 14:09:58 user nova-compute[75326]:       <stats period='10'/>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='balloon0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </memballoon>
Dec 06 14:09:58 user nova-compute[75326]:     <rng model='virtio'>
Dec 06 14:09:58 user nova-compute[75326]:       <backend model='random'>/dev/urandom</backend>
Dec 06 14:09:58 user nova-compute[75326]:       <alias name='rng0'/>
Dec 06 14:09:58 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 14:09:58 user nova-compute[75326]:     </rng>
Dec 06 14:09:58 user nova-compute[75326]:   </devices>
Dec 06 14:09:58 user nova-compute[75326]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 14:09:58 user nova-compute[75326]:     <label>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</label>
Dec 06 14:09:58 user nova-compute[75326]:     <imagelabel>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</imagelabel>
Dec 06 14:09:58 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:58 user nova-compute[75326]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 14:09:58 user nova-compute[75326]:     <label>+64055:+108</label>
Dec 06 14:09:58 user nova-compute[75326]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 14:09:58 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:58 user nova-compute[75326]: </domain>
Dec 06 14:09:58 user nova-compute[75326]:  {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 14:09:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully detached device tapa73d21ea-90 from instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb from the live domain config.
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_vif [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73d21ea-90, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be2db3a0-deff-45ae-b245-14057a048895) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:09:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:09:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:58 user nova-compute[75326]: INFO os_vif [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90')
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:58 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:58</nova:creationTime>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:58 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:58 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:58 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:58 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:58 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:58 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:58 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:58 user nova-compute[75326]:  {{(pid=75326) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:09:58 user nova-compute[75326]: INFO nova.virt.block_device [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Booting with volume 95a6b7be-a953-441b-9861-af13a9703c9d at /dev/vda
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.policy [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f11d9a8432cf4fc89535615a3cb0d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d98376fb5a46db9dc51d8e158a99e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.utils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a677bd8a-5cdf-44f2-8b4d-93cfd0aecdd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6fe27e-361f-4778-9387-f309fcd718a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb68888-eced-4a94-bc98-282bc73f1713]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b4b9a5-60bb-4b1d-a08e-db7647b687ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:09:58 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:09:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc7918-bea2-48cc-be77-51fe6d37dc00]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG os_brick.utils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:09:58 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating existing volume attachment record: 66b69dbc-de7d-4200-af4a-70b082568c1d {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquired lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-deleted-a73d21ea-90ad-4f4a-8f63-8345cf69daea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:09:59 user nova-compute[75326]: INFO nova.compute.manager [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Neutron deleted interface a73d21ea-90ad-4f4a-8f63-8345cf69daea; detaching it from the instance and deleting it from the info cache
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.objects.instance [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Lazy-loading 'system_metadata' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.objects.instance [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Lazy-loading 'flavor' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.objects.base [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Object Instance<03196bf5-7f24-4a32-b7ce-e3b0560ee0bb> lazy-loaded attributes: system_metadata,flavor {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 06 14:09:59 user nova-compute[75326]:   <name>instance-00000007</name>
Dec 06 14:09:59 user nova-compute[75326]:   <uuid>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</uuid>
Dec 06 14:09:59 user nova-compute[75326]:   <metadata>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:59 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:58</nova:creationTime>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:59 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:59 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:59 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:59 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:59 user nova-compute[75326]:   </metadata>
Dec 06 14:09:59 user nova-compute[75326]:   <memory unit='KiB'>524288</memory>
Dec 06 14:09:59 user nova-compute[75326]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 14:09:59 user nova-compute[75326]:   <vcpu placement='static'>1</vcpu>
Dec 06 14:09:59 user nova-compute[75326]:   <resource>
Dec 06 14:09:59 user nova-compute[75326]:     <partition>/machine</partition>
Dec 06 14:09:59 user nova-compute[75326]:   </resource>
Dec 06 14:09:59 user nova-compute[75326]:   <sysinfo type='smbios'>
Dec 06 14:09:59 user nova-compute[75326]:     <system>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='version'>0.0.0</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='serial'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='uuid'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='family'>Virtual Machine</entry>
Dec 06 14:09:59 user nova-compute[75326]:     </system>
Dec 06 14:09:59 user nova-compute[75326]:   </sysinfo>
Dec 06 14:09:59 user nova-compute[75326]:   <os>
Dec 06 14:09:59 user nova-compute[75326]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 14:09:59 user nova-compute[75326]:     <boot dev='hd'/>
Dec 06 14:09:59 user nova-compute[75326]:     <smbios mode='sysinfo'/>
Dec 06 14:09:59 user nova-compute[75326]:   </os>
Dec 06 14:09:59 user nova-compute[75326]:   <features>
Dec 06 14:09:59 user nova-compute[75326]:     <acpi/>
Dec 06 14:09:59 user nova-compute[75326]:     <apic/>
Dec 06 14:09:59 user nova-compute[75326]:     <vmcoreinfo state='on'/>
Dec 06 14:09:59 user nova-compute[75326]:   </features>
Dec 06 14:09:59 user nova-compute[75326]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 14:09:59 user nova-compute[75326]:     <model fallback='forbid'>Nehalem</model>
Dec 06 14:09:59 user nova-compute[75326]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='vme'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='x2apic'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='hypervisor'/>
Dec 06 14:09:59 user nova-compute[75326]:   </cpu>
Dec 06 14:09:59 user nova-compute[75326]:   <clock offset='utc'>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='hpet' present='no'/>
Dec 06 14:09:59 user nova-compute[75326]:   </clock>
Dec 06 14:09:59 user nova-compute[75326]:   <on_poweroff>destroy</on_poweroff>
Dec 06 14:09:59 user nova-compute[75326]:   <on_reboot>restart</on_reboot>
Dec 06 14:09:59 user nova-compute[75326]:   <on_crash>destroy</on_crash>
Dec 06 14:09:59 user nova-compute[75326]:   <devices>
Dec 06 14:09:59 user nova-compute[75326]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 14:09:59 user nova-compute[75326]:     <disk type='file' device='disk'>
Dec 06 14:09:59 user nova-compute[75326]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 14:09:59 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk' index='2'/>
Dec 06 14:09:59 user nova-compute[75326]:       <backingStore type='file' index='3'>
Dec 06 14:09:59 user nova-compute[75326]:         <format type='raw'/>
Dec 06 14:09:59 user nova-compute[75326]:         <source file='/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576'/>
Dec 06 14:09:59 user nova-compute[75326]:         <backingStore/>
Dec 06 14:09:59 user nova-compute[75326]:       </backingStore>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='vda' bus='virtio'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='virtio-disk0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </disk>
Dec 06 14:09:59 user nova-compute[75326]:     <disk type='file' device='cdrom'>
Dec 06 14:09:59 user nova-compute[75326]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 14:09:59 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config' index='1'/>
Dec 06 14:09:59 user nova-compute[75326]:       <backingStore/>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='hda' bus='ide'/>
Dec 06 14:09:59 user nova-compute[75326]:       <readonly/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='ide0-0-0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </disk>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='usb' index='0' model='none'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='usb'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='pci.0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='ide' index='0'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='ide'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <interface type='ethernet'>
Dec 06 14:09:59 user nova-compute[75326]:       <mac address='fa:16:3e:b8:51:61'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='tapf686132b-b2'/>
Dec 06 14:09:59 user nova-compute[75326]:       <model type='virtio'/>
Dec 06 14:09:59 user nova-compute[75326]:       <mtu size='1442'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='net0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </interface>
Dec 06 14:09:59 user nova-compute[75326]:     <serial type='pty'>
Dec 06 14:09:59 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:59 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target type='isa-serial' port='0'>
Dec 06 14:09:59 user nova-compute[75326]:         <model name='isa-serial'/>
Dec 06 14:09:59 user nova-compute[75326]:       </target>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </serial>
Dec 06 14:09:59 user nova-compute[75326]:     <console type='pty' tty='/dev/pts/6'>
Dec 06 14:09:59 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:59 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target type='serial' port='0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </console>
Dec 06 14:09:59 user nova-compute[75326]:     <input type='mouse' bus='ps2'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='input0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </input>
Dec 06 14:09:59 user nova-compute[75326]:     <input type='keyboard' bus='ps2'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='input1'/>
Dec 06 14:09:59 user nova-compute[75326]:     </input>
Dec 06 14:09:59 user nova-compute[75326]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 06 14:09:59 user nova-compute[75326]:       <listen type='address' address='0.0.0.0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </graphics>
Dec 06 14:09:59 user nova-compute[75326]:     <audio id='1' type='none'/>
Dec 06 14:09:59 user nova-compute[75326]:     <video>
Dec 06 14:09:59 user nova-compute[75326]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='video0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </video>
Dec 06 14:09:59 user nova-compute[75326]:     <memballoon model='virtio'>
Dec 06 14:09:59 user nova-compute[75326]:       <stats period='10'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='balloon0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </memballoon>
Dec 06 14:09:59 user nova-compute[75326]:     <rng model='virtio'>
Dec 06 14:09:59 user nova-compute[75326]:       <backend model='random'>/dev/urandom</backend>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='rng0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </rng>
Dec 06 14:09:59 user nova-compute[75326]:   </devices>
Dec 06 14:09:59 user nova-compute[75326]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 14:09:59 user nova-compute[75326]:     <label>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</label>
Dec 06 14:09:59 user nova-compute[75326]:     <imagelabel>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</imagelabel>
Dec 06 14:09:59 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:59 user nova-compute[75326]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 14:09:59 user nova-compute[75326]:     <label>+64055:+108</label>
Dec 06 14:09:59 user nova-compute[75326]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 14:09:59 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:59 user nova-compute[75326]: </domain>
Dec 06 14:09:59 user nova-compute[75326]:  {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface> {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:91:8c:d7"/><model type="virtio"/><mtu size="1442"/><target dev="tapa73d21ea-90"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 06 14:09:59 user nova-compute[75326]:   <name>instance-00000007</name>
Dec 06 14:09:59 user nova-compute[75326]:   <uuid>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</uuid>
Dec 06 14:09:59 user nova-compute[75326]:   <metadata>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:59 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:58</nova:creationTime>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:59 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:59 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:59 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:59 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:59 user nova-compute[75326]:   </metadata>
Dec 06 14:09:59 user nova-compute[75326]:   <memory unit='KiB'>524288</memory>
Dec 06 14:09:59 user nova-compute[75326]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 14:09:59 user nova-compute[75326]:   <vcpu placement='static'>1</vcpu>
Dec 06 14:09:59 user nova-compute[75326]:   <resource>
Dec 06 14:09:59 user nova-compute[75326]:     <partition>/machine</partition>
Dec 06 14:09:59 user nova-compute[75326]:   </resource>
Dec 06 14:09:59 user nova-compute[75326]:   <sysinfo type='smbios'>
Dec 06 14:09:59 user nova-compute[75326]:     <system>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='version'>0.0.0</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='serial'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='uuid'>03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</entry>
Dec 06 14:09:59 user nova-compute[75326]:       <entry name='family'>Virtual Machine</entry>
Dec 06 14:09:59 user nova-compute[75326]:     </system>
Dec 06 14:09:59 user nova-compute[75326]:   </sysinfo>
Dec 06 14:09:59 user nova-compute[75326]:   <os>
Dec 06 14:09:59 user nova-compute[75326]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 14:09:59 user nova-compute[75326]:     <boot dev='hd'/>
Dec 06 14:09:59 user nova-compute[75326]:     <smbios mode='sysinfo'/>
Dec 06 14:09:59 user nova-compute[75326]:   </os>
Dec 06 14:09:59 user nova-compute[75326]:   <features>
Dec 06 14:09:59 user nova-compute[75326]:     <acpi/>
Dec 06 14:09:59 user nova-compute[75326]:     <apic/>
Dec 06 14:09:59 user nova-compute[75326]:     <vmcoreinfo state='on'/>
Dec 06 14:09:59 user nova-compute[75326]:   </features>
Dec 06 14:09:59 user nova-compute[75326]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 14:09:59 user nova-compute[75326]:     <model fallback='forbid'>Nehalem</model>
Dec 06 14:09:59 user nova-compute[75326]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='vme'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='x2apic'/>
Dec 06 14:09:59 user nova-compute[75326]:     <feature policy='require' name='hypervisor'/>
Dec 06 14:09:59 user nova-compute[75326]:   </cpu>
Dec 06 14:09:59 user nova-compute[75326]:   <clock offset='utc'>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 14:09:59 user nova-compute[75326]:     <timer name='hpet' present='no'/>
Dec 06 14:09:59 user nova-compute[75326]:   </clock>
Dec 06 14:09:59 user nova-compute[75326]:   <on_poweroff>destroy</on_poweroff>
Dec 06 14:09:59 user nova-compute[75326]:   <on_reboot>restart</on_reboot>
Dec 06 14:09:59 user nova-compute[75326]:   <on_crash>destroy</on_crash>
Dec 06 14:09:59 user nova-compute[75326]:   <devices>
Dec 06 14:09:59 user nova-compute[75326]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 14:09:59 user nova-compute[75326]:     <disk type='file' device='disk'>
Dec 06 14:09:59 user nova-compute[75326]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 14:09:59 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk' index='2'/>
Dec 06 14:09:59 user nova-compute[75326]:       <backingStore type='file' index='3'>
Dec 06 14:09:59 user nova-compute[75326]:         <format type='raw'/>
Dec 06 14:09:59 user nova-compute[75326]:         <source file='/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576'/>
Dec 06 14:09:59 user nova-compute[75326]:         <backingStore/>
Dec 06 14:09:59 user nova-compute[75326]:       </backingStore>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='vda' bus='virtio'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='virtio-disk0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </disk>
Dec 06 14:09:59 user nova-compute[75326]:     <disk type='file' device='cdrom'>
Dec 06 14:09:59 user nova-compute[75326]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 14:09:59 user nova-compute[75326]:       <source file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk.config' index='1'/>
Dec 06 14:09:59 user nova-compute[75326]:       <backingStore/>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='hda' bus='ide'/>
Dec 06 14:09:59 user nova-compute[75326]:       <readonly/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='ide0-0-0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </disk>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='usb' index='0' model='none'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='usb'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='pci.0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <controller type='ide' index='0'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='ide'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 14:09:59 user nova-compute[75326]:     </controller>
Dec 06 14:09:59 user nova-compute[75326]:     <interface type='ethernet'>
Dec 06 14:09:59 user nova-compute[75326]:       <mac address='fa:16:3e:b8:51:61'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target dev='tapf686132b-b2'/>
Dec 06 14:09:59 user nova-compute[75326]:       <model type='virtio'/>
Dec 06 14:09:59 user nova-compute[75326]:       <mtu size='1442'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='net0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </interface>
Dec 06 14:09:59 user nova-compute[75326]:     <serial type='pty'>
Dec 06 14:09:59 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:59 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target type='isa-serial' port='0'>
Dec 06 14:09:59 user nova-compute[75326]:         <model name='isa-serial'/>
Dec 06 14:09:59 user nova-compute[75326]:       </target>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </serial>
Dec 06 14:09:59 user nova-compute[75326]:     <console type='pty' tty='/dev/pts/6'>
Dec 06 14:09:59 user nova-compute[75326]:       <source path='/dev/pts/6'/>
Dec 06 14:09:59 user nova-compute[75326]:       <log file='/opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/console.log' append='off'/>
Dec 06 14:09:59 user nova-compute[75326]:       <target type='serial' port='0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='serial0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </console>
Dec 06 14:09:59 user nova-compute[75326]:     <input type='mouse' bus='ps2'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='input0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </input>
Dec 06 14:09:59 user nova-compute[75326]:     <input type='keyboard' bus='ps2'>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='input1'/>
Dec 06 14:09:59 user nova-compute[75326]:     </input>
Dec 06 14:09:59 user nova-compute[75326]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 06 14:09:59 user nova-compute[75326]:       <listen type='address' address='0.0.0.0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </graphics>
Dec 06 14:09:59 user nova-compute[75326]:     <audio id='1' type='none'/>
Dec 06 14:09:59 user nova-compute[75326]:     <video>
Dec 06 14:09:59 user nova-compute[75326]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='video0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </video>
Dec 06 14:09:59 user nova-compute[75326]:     <memballoon model='virtio'>
Dec 06 14:09:59 user nova-compute[75326]:       <stats period='10'/>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='balloon0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </memballoon>
Dec 06 14:09:59 user nova-compute[75326]:     <rng model='virtio'>
Dec 06 14:09:59 user nova-compute[75326]:       <backend model='random'>/dev/urandom</backend>
Dec 06 14:09:59 user nova-compute[75326]:       <alias name='rng0'/>
Dec 06 14:09:59 user nova-compute[75326]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 14:09:59 user nova-compute[75326]:     </rng>
Dec 06 14:09:59 user nova-compute[75326]:   </devices>
Dec 06 14:09:59 user nova-compute[75326]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 14:09:59 user nova-compute[75326]:     <label>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</label>
Dec 06 14:09:59 user nova-compute[75326]:     <imagelabel>libvirt-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb</imagelabel>
Dec 06 14:09:59 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:59 user nova-compute[75326]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 14:09:59 user nova-compute[75326]:     <label>+64055:+108</label>
Dec 06 14:09:59 user nova-compute[75326]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 14:09:59 user nova-compute[75326]:   </seclabel>
Dec 06 14:09:59 user nova-compute[75326]: </domain>
Dec 06 14:09:59 user nova-compute[75326]:  {{(pid=75326) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 14:09:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Detaching interface fa:16:3e:91:8c:d7 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa73d21ea-90' not found.
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Converting VIF {"id": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "address": "fa:16:3e:91:8c:d7", "network": {"id": "949c45ad-08b9-451c-b963-1147693b36fa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1251818353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73d21ea-90", "ovs_interfaceid": "a73d21ea-90ad-4f4a-8f63-8345cf69daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG os_vif [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73d21ea-90, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:09:59 user nova-compute[75326]: INFO os_vif [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a73d21ea-90ad-4f4a-8f63-8345cf69daea,network=Network(949c45ad-08b9-451c-b963-1147693b36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73d21ea-90')
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [req-88324919-8760-479a-be8a-6dca0e9f605e req-b998d229-1ebe-4225-bf9f-012503b38122 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:09:59 user nova-compute[75326]:   <nova:package version="0.0.0"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:name>tempest-device-tagging-server-206999601</nova:name>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:creationTime>2023-12-06 14:09:59</nova:creationTime>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:flavor name="m1.tiny">
Dec 06 14:09:59 user nova-compute[75326]:     <nova:memory>512</nova:memory>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:disk>1</nova:disk>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:swap>0</nova:swap>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:vcpus>1</nova:vcpus>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:flavor>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:user uuid="a403f032e48e4862b04d4fdb8680b40c">tempest-TaggedAttachmentsTest-925072589-project-member</nova:user>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:project uuid="5fd0cd38d55641fb8af4654ad2a95c8d">tempest-TaggedAttachmentsTest-925072589</nova:project>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:owner>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:09:59 user nova-compute[75326]:   <nova:ports>
Dec 06 14:09:59 user nova-compute[75326]:     <nova:port uuid="f686132b-b2e9-4590-a52a-1e0e6e1bf504">
Dec 06 14:09:59 user nova-compute[75326]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:09:59 user nova-compute[75326]:     </nova:port>
Dec 06 14:09:59 user nova-compute[75326]:   </nova:ports>
Dec 06 14:09:59 user nova-compute[75326]: </nova:instance>
Dec 06 14:09:59 user nova-compute[75326]:  {{(pid=75326) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 14:09:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Successfully created port: 138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:10:00 user nova-compute[75326]: INFO nova.network.neutron [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Port a73d21ea-90ad-4f4a-8f63-8345cf69daea from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Dec 06 14:10:00 user nova-compute[75326]: DEBUG nova.network.neutron [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [{"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Releasing lock "refresh_cache-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0d62b597-be70-4de6-909b-83dcb90d5faa tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "interface-03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-a73d21ea-90ad-4f4a-8f63-8345cf69daea" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.124s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Successfully updated port: 138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquired lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating instance_info_cache with network_info: [{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Releasing lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance network_info: |[{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-changed-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Refreshing instance network info cache due to event network-changed-138a206a-f7fa-41a9-aaf1-49fd5f4815df. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] Acquiring lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] Acquired lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Refreshing network info cache for port 138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updated VIF entry in instance network info cache for port 138a206a-f7fa-41a9-aaf1-49fd5f4815df. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating instance_info_cache with network_info: [{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-523186e3-5072-449b-ac39-fb0e7a8e86f5 req-fce14a6e-601a-4dc2-8f99-92bc88c9c7d6 service nova] Releasing lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:10:06 user nova-compute[75326]: INFO nova.compute.claims [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Claim successful on node user
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:10:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.policy [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2fac47e105a4ce8af79f6d802ebb59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d51e81a50c4494a2ef06459b6ab745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:10:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Creating image(s)
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "/opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "/opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk 1073741824" returned: 0 in 0.053s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Successfully created port: dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Cannot resize image /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Ensure instance console log exists: /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Successfully updated port: dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquired lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-changed-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Refreshing instance network info cache due to event network-changed-dc176651-7326-4af1-aa71-9ddf5251bb8b. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] Acquiring lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Updating instance_info_cache with network_info: [{"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Releasing lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Instance network_info: |[{"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] Acquired lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.neutron [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Refreshing network info cache for port dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Start _get_guest_xml network_info=[{"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:10:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1070759700',display_name='tempest-VolumesAdminNegativeTest-server-1070759700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1070759700',id=14,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-3d0fkqfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:10:07Z,user_data=None,user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=5c69f4f4-dd48-4302-be57-880e5a91f581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.objects.instance [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c69f4f4-dd48-4302-be57-880e5a91f581 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:10:08 user nova-compute[75326]:   <uuid>5c69f4f4-dd48-4302-be57-880e5a91f581</uuid>
Dec 06 14:10:08 user nova-compute[75326]:   <name>instance-0000000e</name>
Dec 06 14:10:08 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:10:08 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:10:08 user nova-compute[75326]:   <metadata>
Dec 06 14:10:08 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:10:08 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1070759700</nova:name>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:10:08</nova:creationTime>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:10:08 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:10:08 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:owner>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:user uuid="c2fac47e105a4ce8af79f6d802ebb59e">tempest-VolumesAdminNegativeTest-782371247-project-member</nova:user>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:project uuid="72d51e81a50c4494a2ef06459b6ab745">tempest-VolumesAdminNegativeTest-782371247</nova:project>
Dec 06 14:10:08 user nova-compute[75326]:       </nova:owner>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:10:08 user nova-compute[75326]:       <nova:ports>
Dec 06 14:10:08 user nova-compute[75326]:         <nova:port uuid="dc176651-7326-4af1-aa71-9ddf5251bb8b">
Dec 06 14:10:08 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:10:08 user nova-compute[75326]:         </nova:port>
Dec 06 14:10:08 user nova-compute[75326]:       </nova:ports>
Dec 06 14:10:08 user nova-compute[75326]:     </nova:instance>
Dec 06 14:10:08 user nova-compute[75326]:   </metadata>
Dec 06 14:10:08 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:10:08 user nova-compute[75326]:     <system>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="serial">5c69f4f4-dd48-4302-be57-880e5a91f581</entry>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="uuid">5c69f4f4-dd48-4302-be57-880e5a91f581</entry>
Dec 06 14:10:08 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:10:08 user nova-compute[75326]:     </system>
Dec 06 14:10:08 user nova-compute[75326]:   </sysinfo>
Dec 06 14:10:08 user nova-compute[75326]:   <os>
Dec 06 14:10:08 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:10:08 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:10:08 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:10:08 user nova-compute[75326]:   </os>
Dec 06 14:10:08 user nova-compute[75326]:   <features>
Dec 06 14:10:08 user nova-compute[75326]:     <acpi/>
Dec 06 14:10:08 user nova-compute[75326]:     <apic/>
Dec 06 14:10:08 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:10:08 user nova-compute[75326]:   </features>
Dec 06 14:10:08 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:10:08 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:10:08 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:10:08 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:10:08 user nova-compute[75326]:   </clock>
Dec 06 14:10:08 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:10:08 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:10:08 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:10:08 user nova-compute[75326]:   </cpu>
Dec 06 14:10:08 user nova-compute[75326]:   <devices>
Dec 06 14:10:08 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:10:08 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:10:08 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk"/>
Dec 06 14:10:08 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:10:08 user nova-compute[75326]:     </disk>
Dec 06 14:10:08 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:10:08 user nova-compute[75326]:       <mac address="fa:16:3e:6b:27:64"/>
Dec 06 14:10:08 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:08 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:10:08 user nova-compute[75326]:       <target dev="tapdc176651-73"/>
Dec 06 14:10:08 user nova-compute[75326]:     </interface>
Dec 06 14:10:08 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:10:08 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/console.log" append="off"/>
Dec 06 14:10:08 user nova-compute[75326]:     </serial>
Dec 06 14:10:08 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:10:08 user nova-compute[75326]:     <video>
Dec 06 14:10:08 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:08 user nova-compute[75326]:     </video>
Dec 06 14:10:08 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:10:08 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:10:08 user nova-compute[75326]:     </rng>
Dec 06 14:10:08 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:10:08 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:10:08 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:10:08 user nova-compute[75326]:     </memballoon>
Dec 06 14:10:08 user nova-compute[75326]:   </devices>
Dec 06 14:10:08 user nova-compute[75326]: </domain>
Dec 06 14:10:08 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1070759700',display_name='tempest-VolumesAdminNegativeTest-server-1070759700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1070759700',id=14,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-3d0fkqfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:10:07Z,user_data=None,user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=5c69f4f4-dd48-4302-be57-880e5a91f581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG os_vif [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56122a28-ebad-5ab9-85af-c6cdae5b1e82', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc176651-73, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc176651-73, col_values=(('qos', UUID('7aaf5be1-daf7-4580-99f3-9f3517866bc4')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc176651-73, col_values=(('external_ids', {'iface-id': 'dc176651-7326-4af1-aa71-9ddf5251bb8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:27:64', 'vm-uuid': '5c69f4f4-dd48-4302-be57-880e5a91f581'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:08 user nova-compute[75326]: INFO os_vif [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73')
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] No VIF found with MAC fa:16:3e:6b:27:64, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.neutron [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Updated VIF entry in instance network info cache for port dc176651-7326-4af1-aa71-9ddf5251bb8b. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG nova.network.neutron [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Updating instance_info_cache with network_info: [{"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e946898d-0484-426a-8f53-1a27cfb807a4 req-7eee1780-3b0b-49c9-a788-bd23bca170c9 service nova] Releasing lock "refresh_cache-5c69f4f4-dd48-4302-be57-880e5a91f581" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] No waiting events found dispatching network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:10 user nova-compute[75326]: WARNING nova.compute.manager [req-5b6ec63d-5427-49d3-8b90-93c48a94052a req-e5a8ae13-08fd-4bbc-9e02-355a36331bc0 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received unexpected event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b for instance with vm_state building and task_state spawning.
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:10:12 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Instance spawned successfully.
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:12 user nova-compute[75326]: INFO nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Took 5.58 seconds to spawn the instance on the hypervisor.
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] No waiting events found dispatching network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:12 user nova-compute[75326]: WARNING nova.compute.manager [req-97a7835e-a4cf-49f3-8748-ea6fb193b690 req-c3d5b093-e717-48b6-88d1-66f1d271212b service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received unexpected event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b for instance with vm_state building and task_state spawning.
Dec 06 14:10:12 user nova-compute[75326]: INFO nova.compute.manager [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Took 6.41 seconds to build instance.
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa69dbf9-212a-4a90-8073-8ea6c87e0bbb tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.500s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:10:12 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Creating image(s)
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Ensure instance console log exists: /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start _get_guest_xml network_info=[{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '66b69dbc-de7d-4200-af4a-70b082568c1d', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6a3e818-01b6-489c-a351-181a1d84394c', 'attached_at': '', 'detached_at': '', 'volume_id': '95a6b7be-a953-441b-9861-af13a9703c9d', 'serial': '95a6b7be-a953-441b-9861-af13a9703c9d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:10:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:12 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2ff07-671c-456b-b701-53eaca9de5f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:10:12 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc6c4bc-3dfa-4a55-ba0e-d27a94989d17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d] added
Dec 06 14:10:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0d28c-2a3f-420d-adf2-ca87981bebc3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f618ce04-9a64-47e9-a426-6b83e94b7b85]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcaOsKlq {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcaOsKlq" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2626c-21b4-410c-a398-61fada079034]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcaOsKlq'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900ff98-b757-4998-86a7-7cd5980f2244]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74673c5e-bbe7-4201-8291-64d924329ae5]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c8a59-a3a8-4044-a7c0-67d7448ee99d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]
Dec 06 14:10:13 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.
Dec 06 14:10:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.compute.manager [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Terminating instance
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f4c7d8-6ada-459d-9af3-5030dd7158ff]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24b8b8-6b58-43b9-b8aa-ba407de49e39]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:13 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[060beefe-f3c7-477a-adfb-ee685d60246a]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-unplugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] No waiting events found dispatching network-vif-unplugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-62895502-fae7-4fa8-be1b-b5422701da80 req-089cf2e5-5826-4a59-8a1e-a9b95e5721e8 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-unplugged-92a2a357-7508-4527-8d65-c1f629ce44e0 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Instance destroyed successfully.
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lazy-loading 'resources' on Instance uuid 365e5848-c71d-4ecc-97f9-bd8b051c4a6d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.compute.manager [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Terminating instance
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-338647744',display_name='tempest-ServersNegativeTestJSON-server-338647744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-338647744',id=11,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-8sx54rmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:33Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=365e5848-c71d-4ecc-97f9-bd8b051c4a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "92a2a357-7508-4527-8d65-c1f629ce44e0", "address": "fa:16:3e:67:9c:93", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a2a357-75", "ovs_interfaceid": "92a2a357-7508-4527-8d65-c1f629ce44e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG os_vif [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92a2a357-75, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b3fc512-8eb3-4663-b75f-0dc50162198e) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: INFO os_vif [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9c:93,bridge_name='br-int',has_traffic_filtering=True,id=92a2a357-7508-4527-8d65-c1f629ce44e0,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a2a357-75')
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Deleting instance files /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d_del
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Deletion of /opt/stack/data/nova/instances/365e5848-c71d-4ecc-97f9-bd8b051c4a6d_del complete
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:13 user nova-compute[75326]: INFO nova.compute.manager [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Took 0.79 seconds to destroy the instance on the hypervisor.
Dec 06 14:10:13 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:10:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23762616465626362', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762616465626362', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1357608647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lazy-loading 'pci_devices' on Instance uuid e6a3e818-01b6-489c-a351-181a1d84394c {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:10:14 user nova-compute[75326]:   <uuid>e6a3e818-01b6-489c-a351-181a1d84394c</uuid>
Dec 06 14:10:14 user nova-compute[75326]:   <name>instance-0000000d</name>
Dec 06 14:10:14 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:10:14 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:10:14 user nova-compute[75326]:   <metadata>
Dec 06 14:10:14 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:10:14 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:10:14 user nova-compute[75326]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1357608647</nova:name>
Dec 06 14:10:14 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:10:12</nova:creationTime>
Dec 06 14:10:14 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:10:14 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:10:14 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:10:14 user nova-compute[75326]:       <nova:owner>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:user uuid="f11d9a8432cf4fc89535615a3cb0d12b">tempest-ServerActionsV293TestJSON-1067262843-project-member</nova:user>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:project uuid="54d98376fb5a46db9dc51d8e158a99e1">tempest-ServerActionsV293TestJSON-1067262843</nova:project>
Dec 06 14:10:14 user nova-compute[75326]:       </nova:owner>
Dec 06 14:10:14 user nova-compute[75326]:       <nova:ports>
Dec 06 14:10:14 user nova-compute[75326]:         <nova:port uuid="138a206a-f7fa-41a9-aaf1-49fd5f4815df">
Dec 06 14:10:14 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 14:10:14 user nova-compute[75326]:         </nova:port>
Dec 06 14:10:14 user nova-compute[75326]:       </nova:ports>
Dec 06 14:10:14 user nova-compute[75326]:     </nova:instance>
Dec 06 14:10:14 user nova-compute[75326]:   </metadata>
Dec 06 14:10:14 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:10:14 user nova-compute[75326]:     <system>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="serial">e6a3e818-01b6-489c-a351-181a1d84394c</entry>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="uuid">e6a3e818-01b6-489c-a351-181a1d84394c</entry>
Dec 06 14:10:14 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:10:14 user nova-compute[75326]:     </system>
Dec 06 14:10:14 user nova-compute[75326]:   </sysinfo>
Dec 06 14:10:14 user nova-compute[75326]:   <os>
Dec 06 14:10:14 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:10:14 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:10:14 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:10:14 user nova-compute[75326]:   </os>
Dec 06 14:10:14 user nova-compute[75326]:   <features>
Dec 06 14:10:14 user nova-compute[75326]:     <acpi/>
Dec 06 14:10:14 user nova-compute[75326]:     <apic/>
Dec 06 14:10:14 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:10:14 user nova-compute[75326]:   </features>
Dec 06 14:10:14 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:10:14 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:10:14 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:10:14 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:10:14 user nova-compute[75326]:   </clock>
Dec 06 14:10:14 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:10:14 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:10:14 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:10:14 user nova-compute[75326]:   </cpu>
Dec 06 14:10:14 user nova-compute[75326]:   <devices>
Dec 06 14:10:14 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:10:14 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:10:14 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:10:14 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:10:14 user nova-compute[75326]:       <serial>95a6b7be-a953-441b-9861-af13a9703c9d</serial>
Dec 06 14:10:14 user nova-compute[75326]:     </disk>
Dec 06 14:10:14 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:10:14 user nova-compute[75326]:       <mac address="fa:16:3e:f3:32:4c"/>
Dec 06 14:10:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:14 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:10:14 user nova-compute[75326]:       <target dev="tap138a206a-f7"/>
Dec 06 14:10:14 user nova-compute[75326]:     </interface>
Dec 06 14:10:14 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:10:14 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c/console.log" append="off"/>
Dec 06 14:10:14 user nova-compute[75326]:     </serial>
Dec 06 14:10:14 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:10:14 user nova-compute[75326]:     <video>
Dec 06 14:10:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:14 user nova-compute[75326]:     </video>
Dec 06 14:10:14 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:10:14 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:10:14 user nova-compute[75326]:     </rng>
Dec 06 14:10:14 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:10:14 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:10:14 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:10:14 user nova-compute[75326]:     </memballoon>
Dec 06 14:10:14 user nova-compute[75326]:   </devices>
Dec 06 14:10:14 user nova-compute[75326]: </domain>
Dec 06 14:10:14 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1357608647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG os_vif [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2086445f-e71b-57a3-abbc-953b010026f5', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138a206a-f7, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap138a206a-f7, col_values=(('qos', UUID('47e1b48b-7589-409c-9708-6ae0fc462617')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap138a206a-f7, col_values=(('external_ids', {'iface-id': '138a206a-f7fa-41a9-aaf1-49fd5f4815df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:32:4c', 'vm-uuid': 'e6a3e818-01b6-489c-a351-181a1d84394c'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: INFO os_vif [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7')
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] No VIF found with MAC fa:16:3e:f3:32:4c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Took 0.58 seconds to deallocate network for instance.
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-4b6fc7e9-0d92-4aa2-9cc5-3dcfaefc97f9 req-fa893af1-7254-4056-9c88-05837f6398e5 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-deleted-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.compute.manager [req-4b6fc7e9-0d92-4aa2-9cc5-3dcfaefc97f9 req-fa893af1-7254-4056-9c88-05837f6398e5 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Neutron deleted interface 92a2a357-7508-4527-8d65-c1f629ce44e0; detaching it from the instance and deleting it from the info cache
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-4b6fc7e9-0d92-4aa2-9cc5-3dcfaefc97f9 req-fa893af1-7254-4056-9c88-05837f6398e5 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-4b6fc7e9-0d92-4aa2-9cc5-3dcfaefc97f9 req-fa893af1-7254-4056-9c88-05837f6398e5 service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Detach interface failed, port_id=92a2a357-7508-4527-8d65-c1f629ce44e0, reason: Instance 365e5848-c71d-4ecc-97f9-bd8b051c4a6d could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Instance destroyed successfully.
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lazy-loading 'resources' on Instance uuid 872abe6f-2e97-4ac4-98c3-fb52778e33ce {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-964053311',display_name='tempest-VolumesAssistedSnapshotsTest-server-964053311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-964053311',id=9,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPmcxPUa0a6oHrnbidJkqqhjeBOmgumRsbFcNoM4a9L4JddThhzSs2hQ7dwswTk8VDagtFgTse8gXhhdVwgi1PXynyySVWBDa5PnP/EyUPSfL+JiyjdApf51n9xqgb6Kw==',key_name='tempest-keypair-1559932994',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77600d303d4443cda73f52c12a549613',ramdisk_id='',reservation_id='r-bt1nmvfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-886439876',owner_user_name='tempest-VolumesAssistedSnapshotsTest-886439876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b192e6cb6b4dd68e3f486c54b7914d',uuid=872abe6f-2e97-4ac4-98c3-fb52778e33ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converting VIF {"id": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "address": "fa:16:3e:78:d6:c2", "network": {"id": "f394c711-e500-4219-9009-1e72c0bb4a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1106474420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77600d303d4443cda73f52c12a549613", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb531cd-cc", "ovs_interfaceid": "3bb531cd-ccf4-44a1-8f23-53474ef96150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG os_vif [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bb531cd-cc, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8067f1b9-8378-4665-b5a8-d69bf0538514) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:14 user nova-compute[75326]: INFO os_vif [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3bb531cd-ccf4-44a1-8f23-53474ef96150,network=Network(f394c711-e500-4219-9009-1e72c0bb4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb531cd-cc')
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Deleting instance files /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce_del
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Deletion of /opt/stack/data/nova/instances/872abe6f-2e97-4ac4-98c3-fb52778e33ce_del complete
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:14 user nova-compute[75326]: INFO nova.compute.manager [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Took 1.27 seconds to destroy the instance on the hypervisor.
Dec 06 14:10:14 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:10:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:15 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Deleted allocations for instance 365e5848-c71d-4ecc-97f9-bd8b051c4a6d
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3abadf43-14eb-4d81-99db-bce065432957 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Acquiring lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "365e5848-c71d-4ecc-97f9-bd8b051c4a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] No waiting events found dispatching network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:15 user nova-compute[75326]: WARNING nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 365e5848-c71d-4ecc-97f9-bd8b051c4a6d] Received unexpected event network-vif-plugged-92a2a357-7508-4527-8d65-c1f629ce44e0 for instance with vm_state deleted and task_state None.
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-unplugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] No waiting events found dispatching network-vif-unplugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-unplugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Acquiring lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] No waiting events found dispatching network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:15 user nova-compute[75326]: WARNING nova.compute.manager [req-888cedfb-c598-4311-b092-a0ac22c58610 req-13ffd127-7d48-434b-aa39-5353c40a0b4c service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received unexpected event network-vif-plugged-3bb531cd-ccf4-44a1-8f23-53474ef96150 for instance with vm_state active and task_state deleting.
Dec 06 14:10:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:15 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Took 0.92 seconds to deallocate network for instance.
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:16 user nova-compute[75326]: WARNING nova.compute.manager [req-f0ef6061-77d6-494a-acf2-f5ed4fcc95b6 req-2a580a28-6ce2-46d6-af8f-f4f11bb972af service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state building and task_state spawning.
Dec 06 14:10:16 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:16 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Deleted allocations for instance 872abe6f-2e97-4ac4-98c3-fb52778e33ce
Dec 06 14:10:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-5f0d2259-8fb2-487b-a589-a872d1c4a235 req-0a386272-fedc-4549-baa3-2333a7187e14 service nova] [instance: 872abe6f-2e97-4ac4-98c3-fb52778e33ce] Received event network-vif-deleted-3bb531cd-ccf4-44a1-8f23-53474ef96150 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-facd8a92-ab3f-43a2-a6d8-3905e6a98642 tempest-VolumesAssistedSnapshotsTest-886439876 tempest-VolumesAssistedSnapshotsTest-886439876-project-member] Lock "872abe6f-2e97-4ac4-98c3-fb52778e33ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:10:17 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance spawned successfully.
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:18 user nova-compute[75326]: INFO nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Took 5.26 seconds to spawn the instance on the hypervisor.
Dec 06 14:10:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:10:18 user nova-compute[75326]: INFO nova.compute.manager [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Took 20.07 seconds to build instance.
Dec 06 14:10:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-7eca-45f6-8206-8908d1777539 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.159s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:18 user nova-compute[75326]: WARNING nova.compute.manager [req-e648ca49-cb6e-4a0d-adcf-9432326b899c req-551be4a2-134f-4793-a4e8-ebfba0cc46f9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state None.
Dec 06 14:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:10:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'flavor' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=25.635910034179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.523s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance be7c9178-71ea-4b1e-a926-e890d5efd218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 23c0e05a-eef8-4b0c-b15d-2263997734b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e6a3e818-01b6-489c-a351-181a1d84394c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 5c69f4f4-dd48-4302-be57-880e5a91f581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:27 user nova-compute[75326]: INFO nova.compute.manager [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Attaching volume 5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 to /dev/vdb
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.utils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe727da-4e8f-490d-95b1-ad8d4a12529d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e222fdde-99f5-41c2-bc7e-b59586f71a49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e2e797-a236-4f29-8f68-5a4fdfa9ac74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4199a-89e6-4a7b-9b1e-ced75886035b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:10:27 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e66e5-7e33-4aae-879f-48c93566204a]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG os_brick.utils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating existing volume attachment record: 4b42671a-9748-4b82-b790-8c36255530f8 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:10:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:28 user nova-compute[75326]: INFO nova.compute.manager [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Terminating instance
Dec 06 14:10:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:10:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-unplugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-unplugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-ffdcec5d-d271-445f-b8ba-cf85b2a7fe0b req-65bc3774-5104-439f-9507-93164398f653 service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-unplugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [{"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-be7c9178-71ea-4b1e-a926-e890d5efd218" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:10:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Instance destroyed successfully.
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lazy-loading 'resources' on Instance uuid 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-206999601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-206999601',id=7,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqu/uQCfof8ovVzak9iDcDjnT4oF8OMyjSCiiSh4gSeBAwFOLRqE7JaSvShdAihtfPLdT+u++1iRyLzLF3lJGsfHWZxzzSJjAMYj2Ms5Ob8ceYQtLLhAwtJGG8O1tffmg==',key_name='tempest-keypair-815687071',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd0cd38d55641fb8af4654ad2a95c8d',ramdisk_id='',reservation_id='r-r4gmir00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-925072589',owner_user_name='tempest-TaggedAttachmentsTest-925072589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a403f032e48e4862b04d4fdb8680b40c',uuid=03196bf5-7f24-4a32-b7ce-e3b0560ee0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converting VIF {"id": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "address": "fa:16:3e:b8:51:61", "network": {"id": "52c65da1-2193-4dcd-abf4-eaa43f189c27", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-522996247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd0cd38d55641fb8af4654ad2a95c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686132b-b2", "ovs_interfaceid": "f686132b-b2e9-4590-a52a-1e0e6e1bf504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG os_vif [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf686132b-b2, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2fb6a51-4e38-4e3b-86d0-76a6aa0affe2) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:29 user nova-compute[75326]: INFO os_vif [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:51:61,bridge_name='br-int',has_traffic_filtering=True,id=f686132b-b2e9-4590-a52a-1e0e6e1bf504,network=Network(52c65da1-2193-4dcd-abf4-eaa43f189c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686132b-b2')
Dec 06 14:10:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Deleting instance files /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb_del
Dec 06 14:10:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Deletion of /opt/stack/data/nova/instances/03196bf5-7f24-4a32-b7ce-e3b0560ee0bb_del complete
Dec 06 14:10:29 user nova-compute[75326]: INFO nova.compute.manager [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 14:10:29 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:10:29 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:30 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Took 0.81 seconds to deallocate network for instance.
Dec 06 14:10:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-8b9c0963-49ec-44ed-9ec7-bc30f15bda7d req-b77a74ef-8f19-432b-a77a-1acd86f5cb4a service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-deleted-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:30 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:31 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Deleted allocations for instance 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb
Dec 06 14:10:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1ae04496-64f3-42b7-b345-ec3c7d013758 tempest-TaggedAttachmentsTest-925072589 tempest-TaggedAttachmentsTest-925072589-project-member] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.275s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] Acquiring lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] Lock "03196bf5-7f24-4a32-b7ce-e3b0560ee0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] No waiting events found dispatching network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:31 user nova-compute[75326]: WARNING nova.compute.manager [req-714217ba-f0b0-4d7f-8324-87f2577c0b37 req-c657cd2e-ce9a-4907-9dfa-5776cca456fa service nova] [instance: 03196bf5-7f24-4a32-b7ce-e3b0560ee0bb] Received unexpected event network-vif-plugged-f686132b-b2e9-4590-a52a-1e0e6e1bf504 for instance with vm_state deleted and task_state None.
Dec 06 14:10:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'info_cache' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance destroyed successfully.
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'resources' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9cd70bf-7e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01970e7a-569a-4e12-ba04-8d39373fc33c) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:36 user nova-compute[75326]: INFO os_vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:10:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:36 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3749d8-6e4d-4308-a9c8-655e38df75aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:10:36 user nova-compute[75326]: No targets found.
Dec 06 14:10:36 user nova-compute[75326]: iSNS:
Dec 06 14:10:36 user nova-compute[75326]: No targets found.
Dec 06 14:10:36 user nova-compute[75326]: STATIC:
Dec 06 14:10:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:10:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:10:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:10:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:36 user nova-compute[75326]: FIRMWARE:
Dec 06 14:10:36 user nova-compute[75326]: No targets found.
Dec 06 14:10:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:10:36 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:10:36 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eeb7c7-b126-4648-8c49-3427264ea3b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d96559-cbdd-4bcb-94e9-ad68bdf5c0d0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:36 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:36 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:36 user nova-compute[75326]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:36 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc1285e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf041e1-8e8e-4c33-8495-c268bee95acc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1473b2a-0b61-4930-b9c4-3fce7feb63d0]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cd046-a0f4-4cd1-9c83-dcbf8a8ad619]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cc2c70-2039-43b7-9e9d-f6449799187c]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e5e24-dea3-480c-ace6-5a81eb6133bd]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f7654-e019-4c5f-8951-bef668aca366]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]
Dec 06 14:10:36 user nova-compute[75326]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.
Dec 06 14:10:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c06f64-2229-4394-b3e9-7a6e35eeb36b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== disconnect_volume: return (309ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start _get_guest_xml network_info=[{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '4e647df6-31bf-4f28-a0f9-84902b6fe5ee', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7007fec3-20a9-408b-ac10-067919ebab46', 'attached_at': '', 'detached_at': '', 'volume_id': '1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'serial': '1a1d9f39-ed37-45ff-a0b8-f40e976444b3'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'numa_topology' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:37 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:37 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:37 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3553fe0-64c6-4b28-ac70-864f5a21a167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:10:37 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4abd7-7990-43d7-ae51-dd28fc3d73f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3] added
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b71a4e-ca86-4c11-98cf-f60a9a51939e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4930ec0b-6aec-4559-8d08-075e04a67693]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBDTnXQ {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBDTnXQ" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2099263-6c07-442b-b4ac-06e5e8078672]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybBDTnXQ'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc847ec-7977-4388-b827-57fe3bb17685]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[534fccf1-cb15-4e60-a79b-eebff74315e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce07c3-59c0-45e4-a7b7-45fbc610c04c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]
Dec 06 14:10:37 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd7bf1-2083-49b8-ab8e-60586d831bf6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec3329-1a45-4bfd-9d82-edefcf19c61c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:37 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fb7f9-c617-4d0d-947c-f7ac19827560]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:10:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23065616364616435', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616364616435', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'pci_devices' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:10:38 user nova-compute[75326]:   <uuid>7007fec3-20a9-408b-ac10-067919ebab46</uuid>
Dec 06 14:10:38 user nova-compute[75326]:   <name>instance-00000003</name>
Dec 06 14:10:38 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:10:38 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:10:38 user nova-compute[75326]:   <metadata>
Dec 06 14:10:38 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:10:38 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeTestJSON-server-1364634591</nova:name>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:10:37</nova:creationTime>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:10:38 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:10:38 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:owner>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:user uuid="691bec5c3db54e5d8bedc6193b976c01">tempest-AttachVolumeTestJSON-653396495-project-member</nova:user>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:project uuid="83c49428c1da4c6592df6be7874c46f7">tempest-AttachVolumeTestJSON-653396495</nova:project>
Dec 06 14:10:38 user nova-compute[75326]:       </nova:owner>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:10:38 user nova-compute[75326]:       <nova:ports>
Dec 06 14:10:38 user nova-compute[75326]:         <nova:port uuid="b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1">
Dec 06 14:10:38 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:10:38 user nova-compute[75326]:         </nova:port>
Dec 06 14:10:38 user nova-compute[75326]:       </nova:ports>
Dec 06 14:10:38 user nova-compute[75326]:     </nova:instance>
Dec 06 14:10:38 user nova-compute[75326]:   </metadata>
Dec 06 14:10:38 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:10:38 user nova-compute[75326]:     <system>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="serial">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="uuid">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:10:38 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:10:38 user nova-compute[75326]:     </system>
Dec 06 14:10:38 user nova-compute[75326]:   </sysinfo>
Dec 06 14:10:38 user nova-compute[75326]:   <os>
Dec 06 14:10:38 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:10:38 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:10:38 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:10:38 user nova-compute[75326]:   </os>
Dec 06 14:10:38 user nova-compute[75326]:   <features>
Dec 06 14:10:38 user nova-compute[75326]:     <acpi/>
Dec 06 14:10:38 user nova-compute[75326]:     <apic/>
Dec 06 14:10:38 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:10:38 user nova-compute[75326]:   </features>
Dec 06 14:10:38 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:10:38 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:10:38 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:10:38 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:10:38 user nova-compute[75326]:   </clock>
Dec 06 14:10:38 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:10:38 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:10:38 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:10:38 user nova-compute[75326]:   </cpu>
Dec 06 14:10:38 user nova-compute[75326]:   <devices>
Dec 06 14:10:38 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:10:38 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:10:38 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk"/>
Dec 06 14:10:38 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:10:38 user nova-compute[75326]:     </disk>
Dec 06 14:10:38 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:10:38 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:10:38 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:10:38 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:10:38 user nova-compute[75326]:       <serial>1a1d9f39-ed37-45ff-a0b8-f40e976444b3</serial>
Dec 06 14:10:38 user nova-compute[75326]:     </disk>
Dec 06 14:10:38 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:10:38 user nova-compute[75326]:       <mac address="fa:16:3e:f6:6b:62"/>
Dec 06 14:10:38 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:38 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:10:38 user nova-compute[75326]:       <target dev="tapb9cd70bf-7e"/>
Dec 06 14:10:38 user nova-compute[75326]:     </interface>
Dec 06 14:10:38 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:10:38 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/console.log" append="off"/>
Dec 06 14:10:38 user nova-compute[75326]:     </serial>
Dec 06 14:10:38 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:10:38 user nova-compute[75326]:     <video>
Dec 06 14:10:38 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:10:38 user nova-compute[75326]:     </video>
Dec 06 14:10:38 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:10:38 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:10:38 user nova-compute[75326]:     </rng>
Dec 06 14:10:38 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:10:38 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:10:38 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:10:38 user nova-compute[75326]:     </memballoon>
Dec 06 14:10:38 user nova-compute[75326]:   </devices>
Dec 06 14:10:38 user nova-compute[75326]: </domain>
Dec 06 14:10:38 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:39 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:39 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:39 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c0943d-0acd-4d27-8754-769bd48a634b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:10:39 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da5930-4a25-4e85-956c-c8457b8b3adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a6f7ec-b21f-4a1d-ae69-f1b1334d4dc1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ab4af-c491-49a6-abfe-065ecd2be19c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c7501-e963-4df1-a705-8d256e654850]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLbXQwJk'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Cannot resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'migration_context' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1c7057-e1c8-40e8-969e-a202c5d573be]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.objects.base [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78cc2062-af30-5dd0-90ec-4c3d91517523', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11ac3f-19e4-4c00-84ca-5bb1d4384b50]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9cd70bf-7e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9cd70bf-7e, col_values=(('qos', UUID('eac99e94-b6fe-4385-b5ba-81956787cead')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9cd70bf-7e, col_values=(('external_ids', {'iface-id': 'b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6b:62', 'vm-uuid': '7007fec3-20a9-408b-ac10-067919ebab46'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:39 user nova-compute[75326]: INFO os_vif [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba744d-9c74-4f5b-80c9-3a8819ad0983]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:10:39 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[237d55f6-4fcf-4fb4-9c8c-0ad3f5cf394f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16689381-429d-4940-a32f-a478a63f0c7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:10:39 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:39 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d3c59-abbe-4bec-bd65-04798b418e18]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:39 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'flavor' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:10:40 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:10:40 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:10:40 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:10:40 user nova-compute[75326]:   <serial>5ebf9723-a57b-4a0a-b6bb-e1968eda36e9</serial>
Dec 06 14:10:40 user nova-compute[75326]: </disk>
Dec 06 14:10:40 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:41 user nova-compute[75326]: WARNING nova.compute.manager [req-6a3bb16c-f7d7-4a41-9e65-094901c45d4d req-6522d932-0f4c-4241-8434-1005f724b042 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state powering-on.
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No VIF found with MAC fa:16:3e:d4:cf:df, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7fb8e86c-80c1-4a8f-bb4e-e24171843657 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.732s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-changed-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Refreshing instance network info cache due to event network-changed-3d2f9c06-ac9c-408c-bea1-0227694ab74c. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] Acquiring lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] Acquired lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Refreshing network info cache for port 3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:42 user nova-compute[75326]: INFO nova.compute.manager [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Terminating instance
Dec 06 14:10:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updated VIF entry in instance network info cache for port 3d2f9c06-ac9c-408c-bea1-0227694ab74c. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updating instance_info_cache with network_info: [{"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaf7bed-5858-4b38-8ba2-796828dbe19c req-c6a202cd-4fb1-45c4-a6b1-049d2d48b4ac service nova] Releasing lock "refresh_cache-23c0e05a-eef8-4b0c-b15d-2263997734b5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:43 user nova-compute[75326]: WARNING nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state powering-on.
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-unplugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] No waiting events found dispatching network-vif-unplugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-c8d34864-8322-4c29-9821-63e917b46358 req-ac202467-d2f8-4ce8-bb25-5f69f9c43818 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-unplugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Instance destroyed successfully.
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'resources' on Instance uuid 23c0e05a-eef8-4b0c-b15d-2263997734b5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1807003604',display_name='tempest-AttachVolumeNegativeTest-server-1807003604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1807003604',id=12,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQZMW6WSaRVpFwkdPgoOR38fdLFJhEpZ/coOa7Ntc5VTn7xPSlMF9hwwT5ypjmkqIrxXMmwXdfO/wBNbB0EzQk3Op8HBp9mCX4p0wdZVagr8lHTUNYKMSCtu9WNbgW7A==',key_name='tempest-keypair-1384688403',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-tr51lpsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=23c0e05a-eef8-4b0c-b15d-2263997734b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "address": "fa:16:3e:d1:df:e5", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f9c06-ac", "ovs_interfaceid": "3d2f9c06-ac9c-408c-bea1-0227694ab74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG os_vif [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d2f9c06-ac, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff0a8a8e-2b30-43a1-a45e-eae199d15215) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:43 user nova-compute[75326]: INFO os_vif [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:df:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d2f9c06-ac9c-408c-bea1-0227694ab74c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f9c06-ac')
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Deleting instance files /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5_del
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Deletion of /opt/stack/data/nova/instances/23c0e05a-eef8-4b0c-b15d-2263997734b5_del complete
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.compute.manager [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Stashing vm_state: active {{(pid=75326) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance rebooted successfully.
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2a62fea9-ccc0-41d8-ab0d-07ecf2061bdf tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.compute.claims [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Claim successful on node user
Dec 06 14:10:43 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating resource usage from migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.492s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:44 user nova-compute[75326]: INFO nova.compute.manager [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Migrating
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:44 user nova-compute[75326]: INFO nova.compute.rpcapi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:44 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Took 1.35 seconds to deallocate network for instance.
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-3f56f4a8-96a2-49f6-80ec-8d5027b90cc2 req-46ba8b73-e067-4f15-9f7e-8ff899a70e46 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-deleted-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Starting migrate_disk_and_power_off {{(pid=75326) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] Acquiring lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] No waiting events found dispatching network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:45 user nova-compute[75326]: WARNING nova.compute.manager [req-c9e988eb-04e9-47ce-b1f4-ed8bd069fe6d req-9664eb1a-7ccc-484c-9e39-bd26fe3ef6a9 service nova] [instance: 23c0e05a-eef8-4b0c-b15d-2263997734b5] Received unexpected event network-vif-plugged-3d2f9c06-ac9c-408c-bea1-0227694ab74c for instance with vm_state deleted and task_state None.
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Deleted allocations for instance 23c0e05a-eef8-4b0c-b15d-2263997734b5
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-148dcbb8-221c-476b-b6af-f290c71b9ad3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "23c0e05a-eef8-4b0c-b15d-2263997734b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance destroyed successfully.
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap765ea7bc-21, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50df8ec3-9ac8-4f05-970e-d36ab7ddd7be) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:45 user nova-compute[75326]: INFO os_vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:10:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:45 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f6f9f-e1dd-43ab-9f7a-36b860a94073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:10:45 user nova-compute[75326]: No targets found.
Dec 06 14:10:45 user nova-compute[75326]: iSNS:
Dec 06 14:10:45 user nova-compute[75326]: No targets found.
Dec 06 14:10:45 user nova-compute[75326]: STATIC:
Dec 06 14:10:45 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:10:45 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:45 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:45 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:10:45 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:45 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:45 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:10:45 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:45 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:45 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:10:45 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:10:45 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:10:45 user nova-compute[75326]: FIRMWARE:
Dec 06 14:10:45 user nova-compute[75326]: No targets found.
Dec 06 14:10:45 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:10:45 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:10:45 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:10:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2114bcf-4153-457a-9e2f-216aa0b7d0f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3f2404-937e-448e-9393-3c546004e039]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:10:46 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:10:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd4201a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f286d272-0585-4616-8b8c-4e129b6c2d19]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[069cdd8e-cc9b-475a-a8fe-5235022207bd]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab5fc9a-20a6-4d2d-9562-cf248b2df2f6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9391f834-427d-4db4-9ae8-63519efd4ec7]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe8dcb-22c8-4a22-9df9-3395e8074abb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b4ef4-83fc-4f59-8649-0ba5091ad860]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:10:46 user nova-compute[75326]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:10:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffd160d-ebc6-4524-ba8e-928cdc19d7a9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== disconnect_volume: return (384ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_resize/disk /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:10:46 user nova-compute[75326]: WARNING nova.compute.manager [req-22e8ad74-2e30-4962-b9ae-98d910842751 req-13cb2182-4296-4a8f-9204-060415dd4dde service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_migrating.
Dec 06 14:10:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "cp -r /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_resize/disk /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk" returned: 0 in 0.525s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_resize/disk.info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk.info {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "cp -r /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_resize/disk.info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk.info" returned: 0 in 0.035s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG nova.network.neutron [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Port 765ea7bc-2156-4815-bede-834d676d7edd binding to destination host user is already ACTIVE {{(pid=75326) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:10:49 user nova-compute[75326]: DEBUG nova.network.neutron [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.utils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e3fda3-9902-4bbb-bdc1-6e280b902e5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8975ae-93dc-4d2b-b848-b411a99dfe2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7287a06-9251-4100-a454-fefc8d2aa755]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90967ae9-e904-48fd-ad06-10237f8006d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:10:50 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:10:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34cfa3-464a-4ee8-8c61-af6615510a12]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG os_brick.utils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:10:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:10:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Starting finish_migration {{(pid=75326) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:11:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Creating image(s)
Dec 06 14:11:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk. size=21474836480 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk 21474836480 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk 21474836480" returned: 0 in 0.060s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start _get_guest_xml network_info=[{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '6ed6c1a8-44ab-47b5-9234-1c392288005d', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7c41dda6-b0b1-44e3-8696-e085ff4f2bbf', 'attached_at': '2023-12-06T14:11:01.000000', 'detached_at': '', 'volume_id': '5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'serial': '5ebf9723-a57b-4a0a-b6bb-e1968eda36e9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:01 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:01 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:11:01 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:11:01 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:11:01 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[83753097-ef56-49e3-b26a-00580f9c3bb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:11:01 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf1f6f-df29-4e6b-9352-ba27a86361dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c154e1e3-b513-4f6d-a879-29d425e21b3d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57216e-0bc6-419c-ba8f-192edf565a1e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c0733-9526-417b-b300-68382165a20c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLbXQwJk'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade9608-d3c8-4246-a5d5-84ec825f8481]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88cfed-1a3f-455f-bd92-fb5a9428d6e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e13b83b-2a7d-484e-a545-0038c1e5a03d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:11:01 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d17f72-2040-48a5-ab3f-6d01f5eaf55e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:11:01 user nova-compute[75326]: INFO nova.compute.claims [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Claim successful on node user
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[763faba1-d871-435c-b9a4-47bd91530f70]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:01 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e3aba-8bc4-447c-b91e-87cb2a18bf77]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:11:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:11:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:11:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Creating image(s)
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.policy [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '921ceb47e4174eb0b5a47fe727d4a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c14bbf4b604b6282ec7c5e925c2514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.166s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk 1073741824" returned: 0 in 0.049s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:02 user nova-compute[75326]:   <uuid>7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</uuid>
Dec 06 14:11:02 user nova-compute[75326]:   <name>instance-00000005</name>
Dec 06 14:11:02 user nova-compute[75326]:   <memory>2097152</memory>
Dec 06 14:11:02 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:02 user nova-compute[75326]:   <metadata>
Dec 06 14:11:02 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:02 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherB-server-975828569</nova:name>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:01</nova:creationTime>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:flavor name="m1.small">
Dec 06 14:11:02 user nova-compute[75326]:         <nova:memory>2048</nova:memory>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:disk>20</nova:disk>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:02 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:user uuid="accd4da2df4141ff9e19420b42a22056">tempest-ServerActionsTestOtherB-1534306586-project-member</nova:user>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:project uuid="520e0b71d75a4c5cab40749ad8f40539">tempest-ServerActionsTestOtherB-1534306586</nova:project>
Dec 06 14:11:02 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:02 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:02 user nova-compute[75326]:         <nova:port uuid="765ea7bc-2156-4815-bede-834d676d7edd">
Dec 06 14:11:02 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:11:02 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:02 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:02 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:02 user nova-compute[75326]:   </metadata>
Dec 06 14:11:02 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:02 user nova-compute[75326]:     <system>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="serial">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="uuid">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:11:02 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:02 user nova-compute[75326]:     </system>
Dec 06 14:11:02 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:02 user nova-compute[75326]:   <os>
Dec 06 14:11:02 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:02 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:02 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:02 user nova-compute[75326]:   </os>
Dec 06 14:11:02 user nova-compute[75326]:   <features>
Dec 06 14:11:02 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:02 user nova-compute[75326]:     <apic/>
Dec 06 14:11:02 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:02 user nova-compute[75326]:   </features>
Dec 06 14:11:02 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:02 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:02 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:02 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:02 user nova-compute[75326]:   </clock>
Dec 06 14:11:02 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:02 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:02 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:02 user nova-compute[75326]:   </cpu>
Dec 06 14:11:02 user nova-compute[75326]:   <devices>
Dec 06 14:11:02 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:02 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:02 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk"/>
Dec 06 14:11:02 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:02 user nova-compute[75326]:     </disk>
Dec 06 14:11:02 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:11:02 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:11:02 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:11:02 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:11:02 user nova-compute[75326]:       <serial>5ebf9723-a57b-4a0a-b6bb-e1968eda36e9</serial>
Dec 06 14:11:02 user nova-compute[75326]:     </disk>
Dec 06 14:11:02 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:02 user nova-compute[75326]:       <mac address="fa:16:3e:d4:cf:df"/>
Dec 06 14:11:02 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:02 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:02 user nova-compute[75326]:       <target dev="tap765ea7bc-21"/>
Dec 06 14:11:02 user nova-compute[75326]:     </interface>
Dec 06 14:11:02 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:02 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/console.log" append="off"/>
Dec 06 14:11:02 user nova-compute[75326]:     </serial>
Dec 06 14:11:02 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:02 user nova-compute[75326]:     <video>
Dec 06 14:11:02 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:02 user nova-compute[75326]:     </video>
Dec 06 14:11:02 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:02 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:02 user nova-compute[75326]:     </rng>
Dec 06 14:11:02 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:02 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:02 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:02 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:02 user nova-compute[75326]:   </devices>
Dec 06 14:11:02 user nova-compute[75326]: </domain>
Dec 06 14:11:02 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-557034340-network", "vif_mac": "fa:16:3e:d4:cf:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG os_vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20df1455-e5a7-5eef-afcb-d397eca117f6', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap765ea7bc-21, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap765ea7bc-21, col_values=(('qos', UUID('85ac6a6d-9fda-4023-982f-8e0accacf491')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap765ea7bc-21, col_values=(('external_ids', {'iface-id': '765ea7bc-2156-4815-bede-834d676d7edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:df', 'vm-uuid': '7c41dda6-b0b1-44e3-8696-e085ff4f2bbf'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:02 user nova-compute[75326]: INFO os_vif [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] No VIF found with MAC fa:16:3e:d4:cf:df, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Cannot resize image /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Ensure instance console log exists: /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Successfully created port: bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:11:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Successfully updated port: bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:04 user nova-compute[75326]: WARNING nova.compute.manager [req-b425d739-a0e1-4016-b868-ff2f884119e9 req-fcfbc854-6b0e-4f75-9e58-cbecdb7eabbe service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_finish.
Dec 06 14:11:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance network_info: |[{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start _get_guest_xml network_info=[{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3sFuyyzk/u1BsOvoxYJHJzYzfvV/tbfuX4WOqFK41kPQDgOP3iSJqQ9JGWzgR4KoZAI6CTxMRFLHCmKrn+nmCZdDiugZYmnRwd5OmUBe5uIa6zBLN3K81LNegUcIKOPg==',key_name='tempest-keypair-1968467179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.objects.instance [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_devices' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:05 user nova-compute[75326]:   <uuid>125c9956-52f2-465f-98b2-c6a9501f6387</uuid>
Dec 06 14:11:05 user nova-compute[75326]:   <name>instance-0000000f</name>
Dec 06 14:11:05 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:11:05 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:05 user nova-compute[75326]:   <metadata>
Dec 06 14:11:05 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:05 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1949009546</nova:name>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:05</nova:creationTime>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:11:05 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:05 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:user uuid="921ceb47e4174eb0b5a47fe727d4a1d2">tempest-AttachVolumeShelveTestJSON-82698496-project-member</nova:user>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:project uuid="f7c14bbf4b604b6282ec7c5e925c2514">tempest-AttachVolumeShelveTestJSON-82698496</nova:project>
Dec 06 14:11:05 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:05 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:05 user nova-compute[75326]:         <nova:port uuid="bafcbd3d-b6ae-4d10-b52c-7546970b3d65">
Dec 06 14:11:05 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 14:11:05 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:05 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:05 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:05 user nova-compute[75326]:   </metadata>
Dec 06 14:11:05 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:05 user nova-compute[75326]:     <system>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="serial">125c9956-52f2-465f-98b2-c6a9501f6387</entry>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="uuid">125c9956-52f2-465f-98b2-c6a9501f6387</entry>
Dec 06 14:11:05 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:05 user nova-compute[75326]:     </system>
Dec 06 14:11:05 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:05 user nova-compute[75326]:   <os>
Dec 06 14:11:05 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:05 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:05 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:05 user nova-compute[75326]:   </os>
Dec 06 14:11:05 user nova-compute[75326]:   <features>
Dec 06 14:11:05 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:05 user nova-compute[75326]:     <apic/>
Dec 06 14:11:05 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:05 user nova-compute[75326]:   </features>
Dec 06 14:11:05 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:05 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:05 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:05 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:05 user nova-compute[75326]:   </clock>
Dec 06 14:11:05 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:05 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:05 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:05 user nova-compute[75326]:   </cpu>
Dec 06 14:11:05 user nova-compute[75326]:   <devices>
Dec 06 14:11:05 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:05 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:05 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk"/>
Dec 06 14:11:05 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:05 user nova-compute[75326]:     </disk>
Dec 06 14:11:05 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:05 user nova-compute[75326]:       <mac address="fa:16:3e:f9:c7:5a"/>
Dec 06 14:11:05 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:05 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:05 user nova-compute[75326]:       <target dev="tapbafcbd3d-b6"/>
Dec 06 14:11:05 user nova-compute[75326]:     </interface>
Dec 06 14:11:05 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:05 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/console.log" append="off"/>
Dec 06 14:11:05 user nova-compute[75326]:     </serial>
Dec 06 14:11:05 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:05 user nova-compute[75326]:     <video>
Dec 06 14:11:05 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:05 user nova-compute[75326]:     </video>
Dec 06 14:11:05 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:05 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:05 user nova-compute[75326]:     </rng>
Dec 06 14:11:05 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:05 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:05 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:05 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:05 user nova-compute[75326]:   </devices>
Dec 06 14:11:05 user nova-compute[75326]: </domain>
Dec 06 14:11:05 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3sFuyyzk/u1BsOvoxYJHJzYzfvV/tbfuX4WOqFK41kPQDgOP3iSJqQ9JGWzgR4KoZAI6CTxMRFLHCmKrn+nmCZdDiugZYmnRwd5OmUBe5uIa6zBLN3K81LNegUcIKOPg==',key_name='tempest-keypair-1968467179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG os_vif [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef5a91a-1fd4-5f95-bdd6-f0919871ebf7', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbafcbd3d-b6, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbafcbd3d-b6, col_values=(('qos', UUID('309fcacd-bcd1-48ee-9ae7-3010e9e536b1')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbafcbd3d-b6, col_values=(('external_ids', {'iface-id': 'bafcbd3d-b6ae-4d10-b52c-7546970b3d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:c7:5a', 'vm-uuid': '125c9956-52f2-465f-98b2-c6a9501f6387'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:05 user nova-compute[75326]: INFO os_vif [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6')
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No VIF found with MAC fa:16:3e:f9:c7:5a, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance running successfully.
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Failed to set time: agent not configured {{(pid=75326) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-22076913-93a6-4d76-9255-4b2eea2e7a8e tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] finish_migration finished successfully. {{(pid=75326) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing instance network info cache due to event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.network.neutron [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updated VIF entry in instance network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.network.neutron [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:08 user nova-compute[75326]: WARNING nova.compute.manager [req-01758b13-92fa-40b0-bf84-bf985fe4e9c6 req-a67adf14-0ae6-4ebd-9695-3bb2ff6b6f86 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state resize_finish.
Dec 06 14:11:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:08 user nova-compute[75326]: WARNING nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state building and task_state spawning.
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:08 user nova-compute[75326]: WARNING nova.compute.manager [req-81816159-07f3-4d20-aec3-d9e99a2a933e req-33405e95-06ca-46d0-abf2-357f76dfc934 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state building and task_state spawning.
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:11:09 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance spawned successfully.
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:09 user nova-compute[75326]: INFO nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Took 7.13 seconds to spawn the instance on the hypervisor.
Dec 06 14:11:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:09 user nova-compute[75326]: INFO nova.compute.manager [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Took 7.90 seconds to build instance.
Dec 06 14:11:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84c873a7-af9c-481f-a333-dfd6f69523d5 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.125s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:11:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.633590698242188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Applying migration context for instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf as it has an incoming, in-progress migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7. Migration status is finished {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 14:11:29 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating resource usage from migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance be7c9178-71ea-4b1e-a926-e890d5efd218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e6a3e818-01b6-489c-a351-181a1d84394c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 5c69f4f4-dd48-4302-be57-880e5a91f581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 125c9956-52f2-465f-98b2-c6a9501f6387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:11:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:11:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:34 user nova-compute[75326]: INFO nova.compute.manager [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Detaching volume e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:11:34 user nova-compute[75326]: INFO nova.virt.block_device [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Attempting to driver detach volume e1dcceba-da5b-45e1-b9fc-76f1434159af from mountpoint /dev/vdb
Dec 06 14:11:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Attempting to detach device vdb from instance be7c9178-71ea-4b1e-a926-e890d5efd218 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:11:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:11:34 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:11:34 user nova-compute[75326]:   <source dev="/dev/sdf"/>
Dec 06 14:11:34 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:11:34 user nova-compute[75326]:   <serial>e1dcceba-da5b-45e1-b9fc-76f1434159af</serial>
Dec 06 14:11:34 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:11:34 user nova-compute[75326]: </disk>
Dec 06 14:11:34 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:11:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance be7c9178-71ea-4b1e-a926-e890d5efd218 from the persistent domain config.
Dec 06 14:11:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be7c9178-71ea-4b1e-a926-e890d5efd218 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:11:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:11:34 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:11:34 user nova-compute[75326]:   <source dev="/dev/sdf"/>
Dec 06 14:11:34 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:11:34 user nova-compute[75326]:   <serial>e1dcceba-da5b-45e1-b9fc-76f1434159af</serial>
Dec 06 14:11:34 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:11:34 user nova-compute[75326]: </disk>
Dec 06 14:11:34 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:11:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:11:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:11:39 user nova-compute[75326]: INFO nova.compute.claims [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Claim successful on node user
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:11:40 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:11:40 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Creating image(s)
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "/opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "/opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "/opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG nova.policy [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e1450369534ddf885110ad05b10ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1319f4f24f1142278a5287e830e6d88c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.166s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk 1073741824" returned: 0 in 0.066s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Cannot resize image /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Ensure instance console log exists: /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Successfully created port: 4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:11:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Successfully updated port: 4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquired lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-changed-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Refreshing instance network info cache due to event network-changed-4ed35278-449c-4899-8047-1943cf41e4ea. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] Acquiring lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating instance_info_cache with network_info: [{"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Releasing lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Instance network_info: |[{"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] Acquired lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Refreshing network info cache for port 4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Start _get_guest_xml network_info=[{"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-109173860',display_name='tempest-TestServerVolumeAttachmentScenario-server-109173860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-109173860',id=16,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWyPoyiYKfUP9rwYn4k3ktpaQG2xH/cbOiiQk+1fQvuMa6YZSoKEx8bmWLzI1g/WYGRrsEFZydEHUoJA9pbXYQliCh9wG4skCMyokOtzipRyLrVG0TKazZB/ZQgB5ZRcQ==',key_name='tempest-keypair-1675909277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1319f4f24f1142278a5287e830e6d88c',ramdisk_id='',reservation_id='r-cyyju3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-286508729',owner_user_name='tempest-TestServerVolumeAttachmentScenario-286508729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e1450369534ddf885110ad05b10ede',uuid=878463cf-3b96-45ab-a0c7-016de78c16c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converting VIF {"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'pci_devices' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:43 user nova-compute[75326]:   <uuid>878463cf-3b96-45ab-a0c7-016de78c16c9</uuid>
Dec 06 14:11:43 user nova-compute[75326]:   <name>instance-00000010</name>
Dec 06 14:11:43 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:11:43 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:43 user nova-compute[75326]:   <metadata>
Dec 06 14:11:43 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:43 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-109173860</nova:name>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:43</nova:creationTime>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:11:43 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:43 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:user uuid="e6e1450369534ddf885110ad05b10ede">tempest-TestServerVolumeAttachmentScenario-286508729-project-member</nova:user>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:project uuid="1319f4f24f1142278a5287e830e6d88c">tempest-TestServerVolumeAttachmentScenario-286508729</nova:project>
Dec 06 14:11:43 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:43 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:43 user nova-compute[75326]:         <nova:port uuid="4ed35278-449c-4899-8047-1943cf41e4ea">
Dec 06 14:11:43 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:11:43 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:43 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:43 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:43 user nova-compute[75326]:   </metadata>
Dec 06 14:11:43 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:43 user nova-compute[75326]:     <system>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="serial">878463cf-3b96-45ab-a0c7-016de78c16c9</entry>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="uuid">878463cf-3b96-45ab-a0c7-016de78c16c9</entry>
Dec 06 14:11:43 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:43 user nova-compute[75326]:     </system>
Dec 06 14:11:43 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:43 user nova-compute[75326]:   <os>
Dec 06 14:11:43 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:43 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:43 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:43 user nova-compute[75326]:   </os>
Dec 06 14:11:43 user nova-compute[75326]:   <features>
Dec 06 14:11:43 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:43 user nova-compute[75326]:     <apic/>
Dec 06 14:11:43 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:43 user nova-compute[75326]:   </features>
Dec 06 14:11:43 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:43 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:43 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:43 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:43 user nova-compute[75326]:   </clock>
Dec 06 14:11:43 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:43 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:43 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:43 user nova-compute[75326]:   </cpu>
Dec 06 14:11:43 user nova-compute[75326]:   <devices>
Dec 06 14:11:43 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:43 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:43 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk"/>
Dec 06 14:11:43 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:43 user nova-compute[75326]:     </disk>
Dec 06 14:11:43 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:43 user nova-compute[75326]:       <mac address="fa:16:3e:2e:98:af"/>
Dec 06 14:11:43 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:43 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:43 user nova-compute[75326]:       <target dev="tap4ed35278-44"/>
Dec 06 14:11:43 user nova-compute[75326]:     </interface>
Dec 06 14:11:43 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:43 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/console.log" append="off"/>
Dec 06 14:11:43 user nova-compute[75326]:     </serial>
Dec 06 14:11:43 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:43 user nova-compute[75326]:     <video>
Dec 06 14:11:43 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:43 user nova-compute[75326]:     </video>
Dec 06 14:11:43 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:43 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:43 user nova-compute[75326]:     </rng>
Dec 06 14:11:43 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:43 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:43 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:43 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:43 user nova-compute[75326]:   </devices>
Dec 06 14:11:43 user nova-compute[75326]: </domain>
Dec 06 14:11:43 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-109173860',display_name='tempest-TestServerVolumeAttachmentScenario-server-109173860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-109173860',id=16,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWyPoyiYKfUP9rwYn4k3ktpaQG2xH/cbOiiQk+1fQvuMa6YZSoKEx8bmWLzI1g/WYGRrsEFZydEHUoJA9pbXYQliCh9wG4skCMyokOtzipRyLrVG0TKazZB/ZQgB5ZRcQ==',key_name='tempest-keypair-1675909277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1319f4f24f1142278a5287e830e6d88c',ramdisk_id='',reservation_id='r-cyyju3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-286508729',owner_user_name='tempest-TestServerVolumeAttachmentScenario-286508729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e1450369534ddf885110ad05b10ede',uuid=878463cf-3b96-45ab-a0c7-016de78c16c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converting VIF {"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG os_vif [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ee3d60a-87e1-5917-af67-d8d7fd13590c', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed35278-44, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ed35278-44, col_values=(('qos', UUID('c7cf0dc1-b261-4eb6-bfb8-e664cbf5035f')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ed35278-44, col_values=(('external_ids', {'iface-id': '4ed35278-449c-4899-8047-1943cf41e4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:98:af', 'vm-uuid': '878463cf-3b96-45ab-a0c7-016de78c16c9'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:43 user nova-compute[75326]: INFO os_vif [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44')
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No VIF found with MAC fa:16:3e:2e:98:af, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.network.neutron [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updated VIF entry in instance network info cache for port 4ed35278-449c-4899-8047-1943cf41e4ea. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.network.neutron [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating instance_info_cache with network_info: [{"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a05cdf07-420f-42f8-a70a-b0fb6b560100 req-52f888f0-2d6e-4838-a6e8-1581143accd1 service nova] Releasing lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:11:44 user nova-compute[75326]: INFO nova.compute.claims [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Claim successful on node user
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:11:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:11:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.policy [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de94506da0934b2cbbba2c435cc8457b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd60ee5320d4e1eb42c2556e0a993bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:11:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Creating image(s)
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "/opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "/opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk 1073741824" returned: 0 in 0.091s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] No waiting events found dispatching network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:45 user nova-compute[75326]: WARNING nova.compute.manager [req-cc793a28-5fc1-4913-8e20-c63f10bd7863 req-3a78f8c5-40da-4a13-a035-4f86b0360285 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received unexpected event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea for instance with vm_state building and task_state spawning.
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.237s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Cannot resize image /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Ensure instance console log exists: /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Successfully created port: ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.compute.claims [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Claim successful on node user
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Successfully updated port: ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquired lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-changed-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Refreshing instance network info cache due to event network-changed-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] Acquiring lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Instance spawned successfully.
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] No waiting events found dispatching network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:47 user nova-compute[75326]: WARNING nova.compute.manager [req-78f0bd5d-d005-4537-9df5-6e34611f7dc0 req-209e761d-6478-448e-9579-969e4e684cc0 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received unexpected event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea for instance with vm_state building and task_state spawning.
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Took 7.26 seconds to spawn the instance on the hypervisor.
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.compute.manager [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Took 8.19 seconds to build instance.
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a4bf606-8f7b-4885-8fd4-e5cd0c697d49 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.376s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updating instance_info_cache with network_info: [{"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.policy [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '779267c6564b43c293a1025a9c575b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cdbc282e0a4495b38e0383600b8363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Releasing lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Instance network_info: |[{"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] Acquired lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Refreshing network info cache for port ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Start _get_guest_xml network_info=[{"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:11:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Creating image(s)
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:48 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:48 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1893561618',display_name='tempest-TestVolumeSwap-server-1893561618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1893561618',id=17,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTHhqa7Wfj/iKDoIfSIoEVCrogI4RJ9HNnfopd6SGd3+iuKleAyOpJKf3rzTkk5LuGIJPkW2gZFzLJqUbj4FUGEcZzGRAMozmEbruLcOXGZGp/PW6vFfOnJXOWK/N8qiw==',key_name='tempest-keypair-299244476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd60ee5320d4e1eb42c2556e0a993bd',ramdisk_id='',reservation_id='r-zz5t0u44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1183255736',owner_user_name='tempest-TestVolumeSwap-1183255736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de94506da0934b2cbbba2c435cc8457b',uuid=bb35ede4-8060-4d88-9fcf-0affecd71acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converting VIF {"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.objects.instance [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lazy-loading 'pci_devices' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:48 user nova-compute[75326]:   <uuid>bb35ede4-8060-4d88-9fcf-0affecd71acd</uuid>
Dec 06 14:11:48 user nova-compute[75326]:   <name>instance-00000011</name>
Dec 06 14:11:48 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:11:48 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:48 user nova-compute[75326]:   <metadata>
Dec 06 14:11:48 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:48 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:name>tempest-TestVolumeSwap-server-1893561618</nova:name>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:48</nova:creationTime>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:11:48 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:48 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:user uuid="de94506da0934b2cbbba2c435cc8457b">tempest-TestVolumeSwap-1183255736-project-member</nova:user>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:project uuid="cdd60ee5320d4e1eb42c2556e0a993bd">tempest-TestVolumeSwap-1183255736</nova:project>
Dec 06 14:11:48 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:48 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:48 user nova-compute[75326]:         <nova:port uuid="ddbdcd98-aa19-4ed6-98ab-2a348f32b5df">
Dec 06 14:11:48 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:11:48 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:48 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:48 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:48 user nova-compute[75326]:   </metadata>
Dec 06 14:11:48 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:48 user nova-compute[75326]:     <system>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="serial">bb35ede4-8060-4d88-9fcf-0affecd71acd</entry>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="uuid">bb35ede4-8060-4d88-9fcf-0affecd71acd</entry>
Dec 06 14:11:48 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:48 user nova-compute[75326]:     </system>
Dec 06 14:11:48 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:48 user nova-compute[75326]:   <os>
Dec 06 14:11:48 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:48 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:48 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:48 user nova-compute[75326]:   </os>
Dec 06 14:11:48 user nova-compute[75326]:   <features>
Dec 06 14:11:48 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:48 user nova-compute[75326]:     <apic/>
Dec 06 14:11:48 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:48 user nova-compute[75326]:   </features>
Dec 06 14:11:48 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:48 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:48 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:48 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:48 user nova-compute[75326]:   </clock>
Dec 06 14:11:48 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:48 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:48 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:48 user nova-compute[75326]:   </cpu>
Dec 06 14:11:48 user nova-compute[75326]:   <devices>
Dec 06 14:11:48 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:48 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:48 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk"/>
Dec 06 14:11:48 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:48 user nova-compute[75326]:     </disk>
Dec 06 14:11:48 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:48 user nova-compute[75326]:       <mac address="fa:16:3e:20:a8:0b"/>
Dec 06 14:11:48 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:48 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:48 user nova-compute[75326]:       <target dev="tapddbdcd98-aa"/>
Dec 06 14:11:48 user nova-compute[75326]:     </interface>
Dec 06 14:11:48 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:48 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/console.log" append="off"/>
Dec 06 14:11:48 user nova-compute[75326]:     </serial>
Dec 06 14:11:48 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:48 user nova-compute[75326]:     <video>
Dec 06 14:11:48 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:48 user nova-compute[75326]:     </video>
Dec 06 14:11:48 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:48 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:48 user nova-compute[75326]:     </rng>
Dec 06 14:11:48 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:48 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:48 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:48 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:48 user nova-compute[75326]:   </devices>
Dec 06 14:11:48 user nova-compute[75326]: </domain>
Dec 06 14:11:48 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1893561618',display_name='tempest-TestVolumeSwap-server-1893561618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1893561618',id=17,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTHhqa7Wfj/iKDoIfSIoEVCrogI4RJ9HNnfopd6SGd3+iuKleAyOpJKf3rzTkk5LuGIJPkW2gZFzLJqUbj4FUGEcZzGRAMozmEbruLcOXGZGp/PW6vFfOnJXOWK/N8qiw==',key_name='tempest-keypair-299244476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd60ee5320d4e1eb42c2556e0a993bd',ramdisk_id='',reservation_id='r-zz5t0u44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1183255736',owner_user_name='tempest-TestVolumeSwap-1183255736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de94506da0934b2cbbba2c435cc8457b',uuid=bb35ede4-8060-4d88-9fcf-0affecd71acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converting VIF {"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG os_vif [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62116143-8ecc-50c5-9ced-1374b2121d66', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddbdcd98-aa, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddbdcd98-aa, col_values=(('qos', UUID('b4db1dd5-ed79-4a8a-a2b6-6bd6662ed955')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddbdcd98-aa, col_values=(('external_ids', {'iface-id': 'ddbdcd98-aa19-4ed6-98ab-2a348f32b5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:a8:0b', 'vm-uuid': 'bb35ede4-8060-4d88-9fcf-0affecd71acd'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:48 user nova-compute[75326]: INFO os_vif [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa')
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.218s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] No VIF found with MAC fa:16:3e:20:a8:0b, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:11:48 user nova-compute[75326]: INFO nova.compute.claims [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Claim successful on node user
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk 1073741824" returned: 0 in 0.058s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Cannot resize image /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Ensure instance console log exists: /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updated VIF entry in instance network info cache for port ddbdcd98-aa19-4ed6-98ab-2a348f32b5df. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.neutron [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updating instance_info_cache with network_info: [{"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Successfully created port: 6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fbec2d77-f98f-4b57-8d09-47d945bd494a req-ada676d8-f7e2-42fe-889b-143d78d22f4e service nova] Releasing lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:11:48 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:11:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.policy [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '779267c6564b43c293a1025a9c575b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cdbc282e0a4495b38e0383600b8363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:11:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Creating image(s)
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-changed-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Refreshing instance network info cache due to event network-changed-138a206a-f7fa-41a9-aaf1-49fd5f4815df. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] Acquiring lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] Acquired lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Refreshing network info cache for port 138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.273s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.250s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk 1073741824" returned: 0 in 0.090s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Successfully updated port: 6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] No waiting events found dispatching network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:50 user nova-compute[75326]: WARNING nova.compute.manager [req-58f37d46-cc70-4835-8299-1aeb1a9172b3 req-62342250-07ab-4546-b8a8-80a21c75e8fb service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received unexpected event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df for instance with vm_state building and task_state spawning.
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-changed-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Refreshing instance network info cache due to event network-changed-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.260s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Cannot resize image /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Ensure instance console log exists: /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Successfully created port: e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updated VIF entry in instance network info cache for port 138a206a-f7fa-41a9-aaf1-49fd5f4815df. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating instance_info_cache with network_info: [{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ec230e5e-7885-4281-8702-d4a12250a8f9 req-29748932-055d-4e6f-ab7f-f9b4f392f24c service nova] Releasing lock "refresh_cache-e6a3e818-01b6-489c-a351-181a1d84394c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance network_info: |[{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Refreshing network info cache for port 6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start _get_guest_xml network_info=[{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:50 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-39709060',display_name='tempest-ServerRescueNegativeTestJSON-server-39709060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-39709060',id=18,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-stsi9yrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:48Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=a1572caf-4d57-4c7c-9250-636f19bfb73a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:51 user nova-compute[75326]:   <uuid>a1572caf-4d57-4c7c-9250-636f19bfb73a</uuid>
Dec 06 14:11:51 user nova-compute[75326]:   <name>instance-00000012</name>
Dec 06 14:11:51 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:11:51 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:51 user nova-compute[75326]:   <metadata>
Dec 06 14:11:51 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:51 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-39709060</nova:name>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:50</nova:creationTime>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:11:51 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:51 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:11:51 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:51 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:51 user nova-compute[75326]:         <nova:port uuid="6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7">
Dec 06 14:11:51 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:11:51 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:51 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:51 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:51 user nova-compute[75326]:   </metadata>
Dec 06 14:11:51 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:51 user nova-compute[75326]:     <system>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="serial">a1572caf-4d57-4c7c-9250-636f19bfb73a</entry>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="uuid">a1572caf-4d57-4c7c-9250-636f19bfb73a</entry>
Dec 06 14:11:51 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:51 user nova-compute[75326]:     </system>
Dec 06 14:11:51 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:51 user nova-compute[75326]:   <os>
Dec 06 14:11:51 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:51 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:51 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:51 user nova-compute[75326]:   </os>
Dec 06 14:11:51 user nova-compute[75326]:   <features>
Dec 06 14:11:51 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:51 user nova-compute[75326]:     <apic/>
Dec 06 14:11:51 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:51 user nova-compute[75326]:   </features>
Dec 06 14:11:51 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:51 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:51 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:51 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:51 user nova-compute[75326]:   </clock>
Dec 06 14:11:51 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:51 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:51 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:51 user nova-compute[75326]:   </cpu>
Dec 06 14:11:51 user nova-compute[75326]:   <devices>
Dec 06 14:11:51 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:51 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:51 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk"/>
Dec 06 14:11:51 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:51 user nova-compute[75326]:     </disk>
Dec 06 14:11:51 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:51 user nova-compute[75326]:       <mac address="fa:16:3e:97:3a:8c"/>
Dec 06 14:11:51 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:51 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:51 user nova-compute[75326]:       <target dev="tap6a16eb4e-37"/>
Dec 06 14:11:51 user nova-compute[75326]:     </interface>
Dec 06 14:11:51 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:51 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/console.log" append="off"/>
Dec 06 14:11:51 user nova-compute[75326]:     </serial>
Dec 06 14:11:51 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:51 user nova-compute[75326]:     <video>
Dec 06 14:11:51 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:51 user nova-compute[75326]:     </video>
Dec 06 14:11:51 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:51 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:51 user nova-compute[75326]:     </rng>
Dec 06 14:11:51 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:51 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:51 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:51 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:51 user nova-compute[75326]:   </devices>
Dec 06 14:11:51 user nova-compute[75326]: </domain>
Dec 06 14:11:51 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-39709060',display_name='tempest-ServerRescueNegativeTestJSON-server-39709060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-39709060',id=18,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-stsi9yrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:48Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=a1572caf-4d57-4c7c-9250-636f19bfb73a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG os_vif [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8b50572-e37d-51ab-bd66-e2f7f58573d4', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a16eb4e-37, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a16eb4e-37, col_values=(('qos', UUID('10b2cd72-64d6-44d2-8ffa-7f9718be8f0c')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a16eb4e-37, col_values=(('external_ids', {'iface-id': '6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:3a:8c', 'vm-uuid': 'a1572caf-4d57-4c7c-9250-636f19bfb73a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:51 user nova-compute[75326]: INFO nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Rebuilding instance
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: INFO os_vif [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37')
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:97:3a:8c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.neutron [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updated VIF entry in instance network info cache for port 6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.neutron [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-acb91506-e146-4574-9e27-843bd727ff31 req-aca46cb8-9bb9-47f5-a949-e45884458054 service nova] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Successfully updated port: e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:51 user nova-compute[75326]: WARNING nova.compute.manager [req-3dc88d75-80e7-4ba4-94c5-4feb3a594980 req-933881ea-7bed-4b2f-9c21-8574fcb1b9e9 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] No waiting events found dispatching network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:52 user nova-compute[75326]: WARNING nova.compute.manager [req-92eb6268-3f62-4677-8a65-24aa576bcb30 req-5b0b9653-c9b8-44ee-b62b-d8584c661fa1 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received unexpected event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df for instance with vm_state building and task_state spawning.
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-changed-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Refreshing instance network info cache due to event network-changed-e8a2b804-acb0-429f-bfbc-3b0db45e811d. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:11:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance destroyed successfully.
Dec 06 14:11:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance destroyed successfully.
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12907677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG os_vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138a206a-f7, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance network_info: |[{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Refreshing network info cache for port e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start _get_guest_xml network_info=[{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47e1b48b-7589-409c-9708-6ae0fc462617) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Instance spawned successfully.
Dec 06 14:11:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:11:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:11:52 user nova-compute[75326]: INFO os_vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7')
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:11:52 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:11:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:11:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-786413736',display_name='tempest-ServerRescueNegativeTestJSON-server-786413736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-786413736',id=19,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-aizogry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:49Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=82db1a45-6725-46c9-9359-cf1b0cb90e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc8bbb1-5fec-4f7d-970a-3e9ce62ad062]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]: iSNS:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]: STATIC:
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: FIRMWARE:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:11:53 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:11:53 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:11:53 user nova-compute[75326]:   <uuid>82db1a45-6725-46c9-9359-cf1b0cb90e65</uuid>
Dec 06 14:11:53 user nova-compute[75326]:   <name>instance-00000013</name>
Dec 06 14:11:53 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:11:53 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:11:53 user nova-compute[75326]:   <metadata>
Dec 06 14:11:53 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:11:53 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-786413736</nova:name>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:11:52</nova:creationTime>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:11:53 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:11:53 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:owner>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:11:53 user nova-compute[75326]:       </nova:owner>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:11:53 user nova-compute[75326]:       <nova:ports>
Dec 06 14:11:53 user nova-compute[75326]:         <nova:port uuid="e8a2b804-acb0-429f-bfbc-3b0db45e811d">
Dec 06 14:11:53 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:11:53 user nova-compute[75326]:         </nova:port>
Dec 06 14:11:53 user nova-compute[75326]:       </nova:ports>
Dec 06 14:11:53 user nova-compute[75326]:     </nova:instance>
Dec 06 14:11:53 user nova-compute[75326]:   </metadata>
Dec 06 14:11:53 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:11:53 user nova-compute[75326]:     <system>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="serial">82db1a45-6725-46c9-9359-cf1b0cb90e65</entry>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="uuid">82db1a45-6725-46c9-9359-cf1b0cb90e65</entry>
Dec 06 14:11:53 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:11:53 user nova-compute[75326]:     </system>
Dec 06 14:11:53 user nova-compute[75326]:   </sysinfo>
Dec 06 14:11:53 user nova-compute[75326]:   <os>
Dec 06 14:11:53 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:11:53 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:11:53 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:11:53 user nova-compute[75326]:   </os>
Dec 06 14:11:53 user nova-compute[75326]:   <features>
Dec 06 14:11:53 user nova-compute[75326]:     <acpi/>
Dec 06 14:11:53 user nova-compute[75326]:     <apic/>
Dec 06 14:11:53 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:11:53 user nova-compute[75326]:   </features>
Dec 06 14:11:53 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:11:53 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:11:53 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:11:53 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:11:53 user nova-compute[75326]:   </clock>
Dec 06 14:11:53 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:11:53 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:11:53 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:11:53 user nova-compute[75326]:   </cpu>
Dec 06 14:11:53 user nova-compute[75326]:   <devices>
Dec 06 14:11:53 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:11:53 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:11:53 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk"/>
Dec 06 14:11:53 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:11:53 user nova-compute[75326]:     </disk>
Dec 06 14:11:53 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:11:53 user nova-compute[75326]:       <mac address="fa:16:3e:e7:8b:25"/>
Dec 06 14:11:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:53 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:11:53 user nova-compute[75326]:       <target dev="tape8a2b804-ac"/>
Dec 06 14:11:53 user nova-compute[75326]:     </interface>
Dec 06 14:11:53 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:11:53 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/console.log" append="off"/>
Dec 06 14:11:53 user nova-compute[75326]:     </serial>
Dec 06 14:11:53 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:11:53 user nova-compute[75326]:     <video>
Dec 06 14:11:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:11:53 user nova-compute[75326]:     </video>
Dec 06 14:11:53 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:11:53 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:11:53 user nova-compute[75326]:     </rng>
Dec 06 14:11:53 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:11:53 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:11:53 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:11:53 user nova-compute[75326]:     </memballoon>
Dec 06 14:11:53 user nova-compute[75326]:   </devices>
Dec 06 14:11:53 user nova-compute[75326]: </domain>
Dec 06 14:11:53 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-786413736',display_name='tempest-ServerRescueNegativeTestJSON-server-786413736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-786413736',id=19,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-aizogry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:49Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=82db1a45-6725-46c9-9359-cf1b0cb90e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_vif [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b78ab484-99b9-5e1b-95dd-97b5ecd02670', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcab7ca-1a35-4e16-b6f9-61d50bb5f47f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a2b804-ac, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8a2b804-ac, col_values=(('qos', UUID('a0144ba3-079b-4c22-8de6-e6ed6dbac4ef')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8a2b804-ac, col_values=(('external_ids', {'iface-id': 'e8a2b804-acb0-429f-bfbc-3b0db45e811d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:8b:25', 'vm-uuid': '82db1a45-6725-46c9-9359-cf1b0cb90e65'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac331ef7-c356-4811-aa99-e77eb5ee99ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44835b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: INFO os_vif [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac')
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6ef004-6c80-44f0-8d12-2370cf5d761b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: INFO nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Took 8.16 seconds to spawn the instance on the hypervisor.
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243b9a9-ab85-4c42-b4de-39c4020042d9]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb00a8-8c9e-46b4-9e5c-63145aad4577]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:e7:8b:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.072s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb500f2-815d-4abb-8820-321b8ec6089b]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090e0bc-c5d5-4c31-96bd-a44ca21309a8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: INFO nova.compute.manager [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Took 9.13 seconds to build instance.
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b708004-61e0-4e4b-8835-de2f7bd575ad]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]
Dec 06 14:11:53 user nova-compute[75326]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-fb45354e-f142-4f59-9d25-b608f04e4374 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.276s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a69d0d-7d8a-46d1-b1e0-163ae68746d3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== disconnect_volume: return (491ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:11:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deleting instance files /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c_del
Dec 06 14:11:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deletion of /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c_del complete
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e6a3e818-01b6-489c-a351-181a1d84394c could not be found.
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:11:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a9a24-e265-4e35-89d7-7e633c95b4cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]: iSNS:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]: STATIC:
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:11:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:53 user nova-compute[75326]: FIRMWARE:
Dec 06 14:11:53 user nova-compute[75326]: No targets found.
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:11:53 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:11:53 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172ae9c-22ec-4242-aaf7-986f97d6746e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updated VIF entry in instance network info cache for port e8a2b804-acb0-429f-bfbc-3b0db45e811d. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[344af3e4-f619-41d1-a83c-00d67b8e6fa5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:53 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4313ac0>, {}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Disconnecting from: [] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== disconnect_volume: return (97ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97dc67ec-aa63-4d57-8db7-f41fd25341f8 req-67452e6e-481f-4d78-a1d6-a7c3f4b14387 service nova] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:53 user nova-compute[75326]: WARNING nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-179d06ee-4645-4ca1-b7b0-6248251c86fa req-ba1e535e-cd2c-4f43-8412-1f7c6d5b130a service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuilding.
Dec 06 14:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state building and task_state spawning.
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:54 user nova-compute[75326]: WARNING nova.compute.manager [req-472c79a5-2895-4d92-8dff-9dbd552b31cd req-ff0bf3c8-4947-411a-b47e-bde880f00891 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state building and task_state spawning.
Dec 06 14:11:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Preparing to wait for external event volume-reimaged-95a6b7be-a953-441b-9861-af13a9703c9d {{(pid=75326) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:55 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be7c9178-71ea-4b1e-a926-e890d5efd218 is timed out.
Dec 06 14:11:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance be7c9178-71ea-4b1e-a926-e890d5efd218 from the live domain config.
Dec 06 14:11:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psDIbLxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:11:55 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f10c0-5e70-492a-abfa-c0b7f5017ca5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:11:55 user nova-compute[75326]: No targets found.
Dec 06 14:11:55 user nova-compute[75326]: iSNS:
Dec 06 14:11:55 user nova-compute[75326]: No targets found.
Dec 06 14:11:55 user nova-compute[75326]: STATIC:
Dec 06 14:11:55 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:11:55 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:55 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:55 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af
Dec 06 14:11:55 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:55 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:55 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:11:55 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:11:55 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:11:55 user nova-compute[75326]: FIRMWARE:
Dec 06 14:11:55 user nova-compute[75326]: No targets found.
Dec 06 14:11:55 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:11:55 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:11:55 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38a32b-13f4-439d-89c0-c1e365d32395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af07cbd-466c-4ed5-82bc-3547470f7366]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:55 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:55 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:55 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:11:55 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:11:55 user nova-compute[75326]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af (non-flash)
Dec 06 14:11:55 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44eda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af'): ({'sdf'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Removing single pathed devices sdf {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975af91-e86e-4b89-908c-2b81668c9f9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ec6f6-d489-430a-b0a5-2018d2360afa]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flushing IO for device /dev/sdf {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a8839-e018-42f3-b3f9-c33595b03a49]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b2025-37e6-4ff6-acba-e2642fa41494]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb6e299-ad90-4e0d-844e-9b533fc2bd17]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b85c448-7263-4ce8-bcd5-70a1d411d96d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260]
Dec 06 14:11:55 user nova-compute[75326]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af, portal: 172.16.0.220,3260] successful.
Dec 06 14:11:55 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1dcceba-da5b-45e1-b9fc-76f1434159af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c3541-c513-41d9-82fb-a8f6422c2d39]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== disconnect_volume: return (370ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:11:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:56 user nova-compute[75326]: WARNING nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state building and task_state spawning.
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:11:56 user nova-compute[75326]: WARNING nova.compute.manager [req-30f409e5-fd1a-493a-b6cd-7fc2761cbc53 req-87f7466a-b510-4948-91b9-1e1c9957a682 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state building and task_state spawning.
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5900024-f0c9-4508-bbb0-b907135818a2 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.214s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance spawned successfully.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Took 9.17 seconds to spawn the instance on the hypervisor.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.compute.manager [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Took 10.22 seconds to build instance.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-58a5a099-8ef6-4943-9f0e-59abac9f5aa9 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.337s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance spawned successfully.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Took 8.41 seconds to spawn the instance on the hypervisor.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:11:57 user nova-compute[75326]: INFO nova.compute.manager [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Took 9.62 seconds to build instance.
Dec 06 14:11:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-29c85835-eba7-41ab-be7c-b17e58b07280 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.777s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:11:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:11:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:04 user nova-compute[75326]: INFO nova.compute.manager [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Terminating instance
Dec 06 14:12:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-unplugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] No waiting events found dispatching network-vif-unplugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-93638360-a29a-45c3-9ef3-2434607eda70 req-e1067fc9-8f24-4609-a5b8-cdd38ede4ebe service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-unplugged-dc176651-7326-4af1-aa71-9ddf5251bb8b for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Instance destroyed successfully.
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.objects.instance [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'resources' on Instance uuid 5c69f4f4-dd48-4302-be57-880e5a91f581 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1070759700',display_name='tempest-VolumesAdminNegativeTest-server-1070759700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1070759700',id=14,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:10:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-3d0fkqfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:10:12Z,user_data=None,user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=5c69f4f4-dd48-4302-be57-880e5a91f581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "address": "fa:16:3e:6b:27:64", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc176651-73", "ovs_interfaceid": "dc176651-7326-4af1-aa71-9ddf5251bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG os_vif [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc176651-73, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aaf5be1-daf7-4580-99f3-9f3517866bc4) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:05 user nova-compute[75326]: INFO os_vif [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:27:64,bridge_name='br-int',has_traffic_filtering=True,id=dc176651-7326-4af1-aa71-9ddf5251bb8b,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc176651-73')
Dec 06 14:12:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Deleting instance files /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581_del
Dec 06 14:12:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Deletion of /opt/stack/data/nova/instances/5c69f4f4-dd48-4302-be57-880e5a91f581_del complete
Dec 06 14:12:05 user nova-compute[75326]: INFO nova.compute.manager [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 14:12:05 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:12:05 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:06 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Took 0.52 seconds to deallocate network for instance.
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-b7c73a93-1eda-45eb-8ab5-2e571bee22fc req-95994c70-e31e-4377-b41a-468b4d31dc34 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-deleted-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:06 user nova-compute[75326]: INFO nova.compute.manager [req-b7c73a93-1eda-45eb-8ab5-2e571bee22fc req-95994c70-e31e-4377-b41a-468b4d31dc34 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Neutron deleted interface dc176651-7326-4af1-aa71-9ddf5251bb8b; detaching it from the instance and deleting it from the info cache
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-b7c73a93-1eda-45eb-8ab5-2e571bee22fc req-95994c70-e31e-4377-b41a-468b4d31dc34 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-b7c73a93-1eda-45eb-8ab5-2e571bee22fc req-95994c70-e31e-4377-b41a-468b4d31dc34 service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Detach interface failed, port_id=dc176651-7326-4af1-aa71-9ddf5251bb8b, reason: Instance 5c69f4f4-dd48-4302-be57-880e5a91f581 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:12:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:06 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Deleted allocations for instance 5c69f4f4-dd48-4302-be57-880e5a91f581
Dec 06 14:12:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-605c41e7-08e8-43b5-93bc-d9d19328deab tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] Acquiring lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] Lock "5c69f4f4-dd48-4302-be57-880e5a91f581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] No waiting events found dispatching network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:07 user nova-compute[75326]: WARNING nova.compute.manager [req-3537fa85-07d5-45c8-96f1-36a30a776f2b req-16eeff3c-0d0c-4296-b1d7-ae1cf5d21a6f service nova] [instance: 5c69f4f4-dd48-4302-be57-880e5a91f581] Received unexpected event network-vif-plugged-dc176651-7326-4af1-aa71-9ddf5251bb8b for instance with vm_state deleted and task_state None.
Dec 06 14:12:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-ce28ae61-9c08-4271-a4ea-a0bf03299150 req-b235d0c2-fdcf-43f4-a1e5-a39ef1443ebc service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event volume-reimaged-95a6b7be-a953-441b-9861-af13a9703c9d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce28ae61-9c08-4271-a4ea-a0bf03299150 req-b235d0c2-fdcf-43f4-a1e5-a39ef1443ebc service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce28ae61-9c08-4271-a4ea-a0bf03299150 req-b235d0c2-fdcf-43f4-a1e5-a39ef1443ebc service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce28ae61-9c08-4271-a4ea-a0bf03299150 req-b235d0c2-fdcf-43f4-a1e5-a39ef1443ebc service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-ce28ae61-9c08-4271-a4ea-a0bf03299150 req-b235d0c2-fdcf-43f4-a1e5-a39ef1443ebc service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Processing event volume-reimaged-95a6b7be-a953-441b-9861-af13a9703c9d {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 06 14:12:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:12:16 user nova-compute[75326]: INFO nova.virt.block_device [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Booting with volume 95a6b7be-a953-441b-9861-af13a9703c9d at /dev/vda
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.utils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f391d13-8389-4c3e-a2a2-86bbc1ff786b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e74544-a548-4a91-8841-43a6e0e03d3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8b3494-561d-48fb-acdc-4a9f8718d184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[83283d5d-6503-41b5-8446-ce7317be8d5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:12:17 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:12:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c58587-0a2a-4cc4-b913-f2cbe01c3856]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG os_brick.utils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:17 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating existing volume attachment record: 080ff03e-628b-45ba-ae6b-a48e84ae9171 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:12:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:24 user nova-compute[75326]: INFO nova.compute.manager [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Terminating instance
Dec 06 14:12:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-unplugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] No waiting events found dispatching network-vif-unplugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-13b16873-c1f8-415a-9161-63a2fdc7264d req-0ad0048c-5344-452f-b72b-6e4b564ea524 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-unplugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Instance destroyed successfully.
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'resources' on Instance uuid be7c9178-71ea-4b1e-a926-e890d5efd218 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518219702',display_name='tempest-AttachVolumeNegativeTest-server-518219702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518219702',id=4,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmyHDDF9BPJRvqatQDLToHPzMljsbehbhhYz72EK2yyfEZr/2Kker7Pn4mSp8m2XJQGM96gx1GGKWUHN1hiIkIq9p2qg5Llu1B855P7qQ23x2aKs2rKsenx/2OA861jpg==',key_name='tempest-keypair-1190683522',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-rx3lmj2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=be7c9178-71ea-4b1e-a926-e890d5efd218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "address": "fa:16:3e:37:b8:45", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba6a1b-7e", "ovs_interfaceid": "11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG os_vif [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11ba6a1b-7e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94ed71be-7dbc-4b41-a86c-3350d0090a04) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:25 user nova-compute[75326]: INFO os_vif [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba6a1b-7e')
Dec 06 14:12:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Deleting instance files /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218_del
Dec 06 14:12:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Deletion of /opt/stack/data/nova/instances/be7c9178-71ea-4b1e-a926-e890d5efd218_del complete
Dec 06 14:12:25 user nova-compute[75326]: INFO nova.compute.manager [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 14:12:25 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:12:25 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:26 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Took 0.67 seconds to deallocate network for instance.
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-d749f7c1-338f-4709-ab55-622dd2efeaac req-bceea3ed-e68b-4d82-9c4d-2bf9fa438a2d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-deleted-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:26 user nova-compute[75326]: INFO nova.compute.manager [req-d749f7c1-338f-4709-ab55-622dd2efeaac req-bceea3ed-e68b-4d82-9c4d-2bf9fa438a2d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Neutron deleted interface 11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381; detaching it from the instance and deleting it from the info cache
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-d749f7c1-338f-4709-ab55-622dd2efeaac req-bceea3ed-e68b-4d82-9c4d-2bf9fa438a2d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-d749f7c1-338f-4709-ab55-622dd2efeaac req-bceea3ed-e68b-4d82-9c4d-2bf9fa438a2d service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Detach interface failed, port_id=11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381, reason: Instance be7c9178-71ea-4b1e-a926-e890d5efd218 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.360s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:12:26 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Deleted allocations for instance be7c9178-71ea-4b1e-a926-e890d5efd218
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d501574-9626-47c5-a5ef-ff22a267f568 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:12:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Creating image(s)
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Ensure instance console log exists: /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start _get_guest_xml network_info=[{"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '080ff03e-628b-45ba-ae6b-a48e84ae9171', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6a3e818-01b6-489c-a351-181a1d84394c', 'attached_at': '', 'detached_at': '', 'volume_id': '95a6b7be-a953-441b-9861-af13a9703c9d', 'serial': '95a6b7be-a953-441b-9861-af13a9703c9d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:12:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 14:12:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6a3e818-01b6-489c-a351-181a1d84394c {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:27 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:27 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:27 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a771170-97d6-4ac6-a604-4831298424a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:12:27 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] Acquiring lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] Lock "be7c9178-71ea-4b1e-a926-e890d5efd218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] No waiting events found dispatching network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:27 user nova-compute[75326]: WARNING nova.compute.manager [req-ca52513b-dd94-4f73-894e-50cce31e91a2 req-2104be23-04f5-4893-8367-e752897fc413 service nova] [instance: be7c9178-71ea-4b1e-a926-e890d5efd218] Received unexpected event network-vif-plugged-11ba6a1b-7ec4-4738-a0b4-5a3bc3fbc381 for instance with vm_state deleted and task_state None.
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986af25-8d4e-4310-a40d-2571c6af43fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d] added
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab80efb5-b50c-4e5f-b792-44b0e62b8075]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d1a92f-8598-44ac-b3df-b8e529fae33c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcaOsKlq {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcaOsKlq" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47da90-c885-4b0c-9844-fc1fbd9408b9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcaOsKlq'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b0176f-a82a-41ff-a83d-95b97456bbce]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dee3a5-ce6b-4806-8cda-c37c361671be]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f50c4-7a25-4321-af8a-d8100903e688]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]
Dec 06 14:12:27 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: INFO nova.compute.manager [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Detaching volume 1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae44d2a-fd5f-4aa3-b1c2-6218e0236e0b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72028cfa-e575-4035-8651-95e8b8a6492c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:27 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:12:27 user nova-compute[75326]: INFO nova.virt.block_device [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Attempting to driver detach volume 1a1d9f39-ed37-45ff-a0b8-f40e976444b3 from mountpoint /dev/vdb
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[424cae34-6d4b-4395-b226-8dc0f076f3a2]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Attempting to detach device vdb from instance 7007fec3-20a9-408b-ac10-067919ebab46 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:12:27 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:12:27 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:12:27 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:12:27 user nova-compute[75326]:   <serial>1a1d9f39-ed37-45ff-a0b8-f40e976444b3</serial>
Dec 06 14:12:27 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:12:27 user nova-compute[75326]: </disk>
Dec 06 14:12:27 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:12:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdb from instance 7007fec3-20a9-408b-ac10-067919ebab46 from the persistent domain config.
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7007fec3-20a9-408b-ac10-067919ebab46 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:12:27 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:12:27 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:12:27 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:12:27 user nova-compute[75326]:   <serial>1a1d9f39-ed37-45ff-a0b8-f40e976444b3</serial>
Dec 06 14:12:27 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:12:27 user nova-compute[75326]: </disk>
Dec 06 14:12:27 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23762616465626362', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762616465626362', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12907677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:12:28 user nova-compute[75326]:   <uuid>e6a3e818-01b6-489c-a351-181a1d84394c</uuid>
Dec 06 14:12:28 user nova-compute[75326]:   <name>instance-0000000d</name>
Dec 06 14:12:28 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:12:28 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:12:28 user nova-compute[75326]:   <metadata>
Dec 06 14:12:28 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:12:28 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:12:28 user nova-compute[75326]:       <nova:name>tempest-ServerActionsV293TestJSON-server-12907677</nova:name>
Dec 06 14:12:28 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:12:27</nova:creationTime>
Dec 06 14:12:28 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:12:28 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:12:28 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:12:28 user nova-compute[75326]:       <nova:owner>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:user uuid="f11d9a8432cf4fc89535615a3cb0d12b">tempest-ServerActionsV293TestJSON-1067262843-project-member</nova:user>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:project uuid="54d98376fb5a46db9dc51d8e158a99e1">tempest-ServerActionsV293TestJSON-1067262843</nova:project>
Dec 06 14:12:28 user nova-compute[75326]:       </nova:owner>
Dec 06 14:12:28 user nova-compute[75326]:       <nova:ports>
Dec 06 14:12:28 user nova-compute[75326]:         <nova:port uuid="138a206a-f7fa-41a9-aaf1-49fd5f4815df">
Dec 06 14:12:28 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 14:12:28 user nova-compute[75326]:         </nova:port>
Dec 06 14:12:28 user nova-compute[75326]:       </nova:ports>
Dec 06 14:12:28 user nova-compute[75326]:     </nova:instance>
Dec 06 14:12:28 user nova-compute[75326]:   </metadata>
Dec 06 14:12:28 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:12:28 user nova-compute[75326]:     <system>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="serial">e6a3e818-01b6-489c-a351-181a1d84394c</entry>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="uuid">e6a3e818-01b6-489c-a351-181a1d84394c</entry>
Dec 06 14:12:28 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:12:28 user nova-compute[75326]:     </system>
Dec 06 14:12:28 user nova-compute[75326]:   </sysinfo>
Dec 06 14:12:28 user nova-compute[75326]:   <os>
Dec 06 14:12:28 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:12:28 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:12:28 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:12:28 user nova-compute[75326]:   </os>
Dec 06 14:12:28 user nova-compute[75326]:   <features>
Dec 06 14:12:28 user nova-compute[75326]:     <acpi/>
Dec 06 14:12:28 user nova-compute[75326]:     <apic/>
Dec 06 14:12:28 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:12:28 user nova-compute[75326]:   </features>
Dec 06 14:12:28 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:12:28 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:12:28 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:12:28 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:12:28 user nova-compute[75326]:   </clock>
Dec 06 14:12:28 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:12:28 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:12:28 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:12:28 user nova-compute[75326]:   </cpu>
Dec 06 14:12:28 user nova-compute[75326]:   <devices>
Dec 06 14:12:28 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:12:28 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:12:28 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:12:28 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:12:28 user nova-compute[75326]:       <serial>95a6b7be-a953-441b-9861-af13a9703c9d</serial>
Dec 06 14:12:28 user nova-compute[75326]:     </disk>
Dec 06 14:12:28 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:12:28 user nova-compute[75326]:       <mac address="fa:16:3e:f3:32:4c"/>
Dec 06 14:12:28 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:12:28 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:12:28 user nova-compute[75326]:       <target dev="tap138a206a-f7"/>
Dec 06 14:12:28 user nova-compute[75326]:     </interface>
Dec 06 14:12:28 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:12:28 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c/console.log" append="off"/>
Dec 06 14:12:28 user nova-compute[75326]:     </serial>
Dec 06 14:12:28 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:12:28 user nova-compute[75326]:     <video>
Dec 06 14:12:28 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:12:28 user nova-compute[75326]:     </video>
Dec 06 14:12:28 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:12:28 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:12:28 user nova-compute[75326]:     </rng>
Dec 06 14:12:28 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:12:28 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:12:28 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:12:28 user nova-compute[75326]:     </memballoon>
Dec 06 14:12:28 user nova-compute[75326]:   </devices>
Dec 06 14:12:28 user nova-compute[75326]: </domain>
Dec 06 14:12:28 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12907677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG os_vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2086445f-e71b-57a3-abbc-953b010026f5', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138a206a-f7, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap138a206a-f7, col_values=(('qos', UUID('4d333384-e496-4db7-8a1f-64b270d72181')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap138a206a-f7, col_values=(('external_ids', {'iface-id': '138a206a-f7fa-41a9-aaf1-49fd5f4815df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:32:4c', 'vm-uuid': 'e6a3e818-01b6-489c-a351-181a1d84394c'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:28 user nova-compute[75326]: INFO os_vif [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7')
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] No VIF found with MAC fa:16:3e:f3:32:4c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:30 user nova-compute[75326]: WARNING nova.compute.manager [req-c48b141a-f7ac-46a7-8b7a-88ab4bc2d3f1 req-6a03e2f9-4e7c-49f2-9a14-482d1e9caad3 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuild_spawning.
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:32 user nova-compute[75326]: WARNING nova.compute.manager [req-9039d145-2a58-48ea-a2a6-997dba8d4784 req-b896350a-95a1-40ab-99f6-95ef3f17c3a4 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state rebuild_spawning.
Dec 06 14:12:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:12:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=25.559860229492188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance spawned successfully.
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Applying migration context for instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf as it has an incoming, in-progress migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7. Migration status is finished {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 14:12:32 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating resource usage from migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b475687e-52b7-4cff-bc22-dbb8b732d1c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e6a3e818-01b6-489c-a351-181a1d84394c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 125c9956-52f2-465f-98b2-c6a9501f6387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 878463cf-3b96-45ab-a0c7-016de78c16c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb35ede4-8060-4d88-9fcf-0affecd71acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:12:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.499s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75326) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ce28ae61-9c08-4271-a4ea-a0bf03299150 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Port 765ea7bc-2156-4815-bede-834d676d7edd binding to destination host user is already ACTIVE {{(pid=75326) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:12:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Creating tmpfile /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/tmp1aej4ee3 to verify with other compute node that the instance is on the same shared storage. {{(pid=75326) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9630}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:34 user nova-compute[75326]: WARNING nova.compute.manager [req-b8356b54-0456-46fc-881b-7f1f0294bf86 req-6c9c9a67-0c46-44ff-be06-8a679b9a4ef1 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state resized and task_state resize_reverting.
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating instance_info_cache with network_info: [{"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-b475687e-52b7-4cff-bc22-dbb8b732d1c6" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance destroyed successfully.
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'resources' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 8b318cff-3431-45bf-8712-ea2d1cd59e3a {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid e6a3e818-01b6-489c-a351-181a1d84394c {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: INFO nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap765ea7bc-21, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ac6a6d-9fda-4023-982f-8e0accacf491) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:35 user nova-compute[75326]: INFO os_vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:35 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69b2231-78b9-42b8-95ca-47ea5c927d72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:12:35 user nova-compute[75326]: No targets found.
Dec 06 14:12:35 user nova-compute[75326]: iSNS:
Dec 06 14:12:35 user nova-compute[75326]: No targets found.
Dec 06 14:12:35 user nova-compute[75326]: STATIC:
Dec 06 14:12:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:12:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:12:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:12:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:35 user nova-compute[75326]: FIRMWARE:
Dec 06 14:12:35 user nova-compute[75326]: No targets found.
Dec 06 14:12:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:12:35 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:12:35 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e0dd80-babd-41cf-bf64-544321a0610e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867ab07-d8a9-497b-aaba-d067d5d1601a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:35 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:35 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:35 user nova-compute[75326]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:35 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3650cf-738e-45d7-af0e-3ccabcde5f96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b09da2-266d-40c6-a560-35f41d917655]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f303e53-7afd-4fcb-802b-c84965aaff06]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9824d-2e6c-499f-8047-83e194fe7408]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b777a652-197c-46b6-ac7e-e13e93b410b4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc0587-9499-495a-8f98-22c9d26293e8]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:12:35 user nova-compute[75326]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:12:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd20049-8912-47ec-9dea-799fdef6f9c1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== disconnect_volume: return (319ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'migration_context' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.objects.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Object Instance<7c41dda6-b0b1-44e3-8696-e085ff4f2bbf> lazy-loaded attributes: resources,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:36 user nova-compute[75326]: WARNING nova.compute.manager [req-25958576-e90f-40c9-bec0-ffd50d863fa2 req-e0b52799-d79e-4555-aea3-2b27c4d62112 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state resized and task_state resize_reverting.
Dec 06 14:12:36 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:12:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.405s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:36 user nova-compute[75326]: INFO nova.compute.manager [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Swapping old allocation on dict_keys(['ba07be03-a218-4efb-ac98-444d17eb9220']) held by migration 8de1f4c9-cae8-41af-ad13-0f13cb097aa7 for instance
Dec 06 14:12:37 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Overwriting current allocation {'allocations': {'ba07be03-a218-4efb-ac98-444d17eb9220': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '520e0b71d75a4c5cab40749ad8f40539', 'user_id': 'accd4da2df4141ff9e19420b42a22056', 'consumer_generation': 1} on consumer 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquired lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Releasing lock "refresh_cache-7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.utils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[76952b43-aa46-4318-b15b-819475520103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e881b-c926-40bc-9237-bd950d62eb34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f30cc1-e90a-45c4-85a6-3a3cc963385e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18c822-276a-443c-8708-1d5a01d430b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:12:37 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:12:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab79b457-0366-4be5-9d9e-f1c90ef4f7a9]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:12:37 user nova-compute[75326]: DEBUG os_brick.utils [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:12:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Starting finish_revert_migration {{(pid=75326) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11822}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start _get_guest_xml network_info=[{"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '7c8b7f02-679a-4b64-b715-f6bb82386466', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7c41dda6-b0b1-44e3-8696-e085ff4f2bbf', 'attached_at': '2023-12-06T14:12:47.000000', 'detached_at': '', 'volume_id': '5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'serial': '5ebf9723-a57b-4a0a-b6bb-e1968eda36e9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:12:47 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:12:47 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:47 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[981a499d-a48d-4069-ba8b-78f7d2da1b35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:12:47 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048bbe8-4316-486c-a3cd-cc767a402220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9] added
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b237064-c359-448c-a7d4-f2887f79c1a1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[59309e70-099e-4529-8f3f-58c165983390]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLbXQwJk" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aca951-f9be-4779-bef1-9d2d44a0bacf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLbXQwJk'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67646957-cd66-425d-9d6c-6d9b06eda726]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5287ce9-3f87-4bd9-941f-d98681856ef2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4200fb-e6c9-4315-a786-84ab47cce6a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:12:47 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ec63d-6c2d-42c0-99b7-f91fbf384380]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de7fa4-5947-4cb6-819e-7ad179dfb393]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:47 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[790a0b43-8791-45c4-8ec5-9e149f810188]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:12:47 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7007fec3-20a9-408b-ac10-067919ebab46 is timed out.
Dec 06 14:12:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdb from instance 7007fec3-20a9-408b-ac10-067919ebab46 from the live domain config.
Dec 06 14:12:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBDTnXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:12:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:12:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063346362653861', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.824s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90714c4-52f0-435b-8761-aad9bc0f6609]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:12:48 user nova-compute[75326]: No targets found.
Dec 06 14:12:48 user nova-compute[75326]: iSNS:
Dec 06 14:12:48 user nova-compute[75326]: No targets found.
Dec 06 14:12:48 user nova-compute[75326]: STATIC:
Dec 06 14:12:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3
Dec 06 14:12:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:12:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:12:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:12:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:12:48 user nova-compute[75326]: FIRMWARE:
Dec 06 14:12:48 user nova-compute[75326]: No targets found.
Dec 06 14:12:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:12:48 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:12:48 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:12:48 user nova-compute[75326]:   <uuid>7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</uuid>
Dec 06 14:12:48 user nova-compute[75326]:   <name>instance-00000005</name>
Dec 06 14:12:48 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:12:48 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:12:48 user nova-compute[75326]:   <metadata>
Dec 06 14:12:48 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:12:48 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherB-server-975828569</nova:name>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:12:47</nova:creationTime>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:12:48 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:12:48 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:owner>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:user uuid="accd4da2df4141ff9e19420b42a22056">tempest-ServerActionsTestOtherB-1534306586-project-member</nova:user>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:project uuid="520e0b71d75a4c5cab40749ad8f40539">tempest-ServerActionsTestOtherB-1534306586</nova:project>
Dec 06 14:12:48 user nova-compute[75326]:       </nova:owner>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:12:48 user nova-compute[75326]:       <nova:ports>
Dec 06 14:12:48 user nova-compute[75326]:         <nova:port uuid="765ea7bc-2156-4815-bede-834d676d7edd">
Dec 06 14:12:48 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:12:48 user nova-compute[75326]:         </nova:port>
Dec 06 14:12:48 user nova-compute[75326]:       </nova:ports>
Dec 06 14:12:48 user nova-compute[75326]:     </nova:instance>
Dec 06 14:12:48 user nova-compute[75326]:   </metadata>
Dec 06 14:12:48 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:12:48 user nova-compute[75326]:     <system>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="serial">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="uuid">7c41dda6-b0b1-44e3-8696-e085ff4f2bbf</entry>
Dec 06 14:12:48 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:12:48 user nova-compute[75326]:     </system>
Dec 06 14:12:48 user nova-compute[75326]:   </sysinfo>
Dec 06 14:12:48 user nova-compute[75326]:   <os>
Dec 06 14:12:48 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:12:48 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:12:48 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:12:48 user nova-compute[75326]:   </os>
Dec 06 14:12:48 user nova-compute[75326]:   <features>
Dec 06 14:12:48 user nova-compute[75326]:     <acpi/>
Dec 06 14:12:48 user nova-compute[75326]:     <apic/>
Dec 06 14:12:48 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:12:48 user nova-compute[75326]:   </features>
Dec 06 14:12:48 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:12:48 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:12:48 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:12:48 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:12:48 user nova-compute[75326]:   </clock>
Dec 06 14:12:48 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:12:48 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:12:48 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:12:48 user nova-compute[75326]:   </cpu>
Dec 06 14:12:48 user nova-compute[75326]:   <devices>
Dec 06 14:12:48 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:12:48 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:12:48 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk"/>
Dec 06 14:12:48 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:12:48 user nova-compute[75326]:     </disk>
Dec 06 14:12:48 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:12:48 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:12:48 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:12:48 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:12:48 user nova-compute[75326]:       <serial>5ebf9723-a57b-4a0a-b6bb-e1968eda36e9</serial>
Dec 06 14:12:48 user nova-compute[75326]:     </disk>
Dec 06 14:12:48 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:12:48 user nova-compute[75326]:       <mac address="fa:16:3e:d4:cf:df"/>
Dec 06 14:12:48 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:12:48 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:12:48 user nova-compute[75326]:       <target dev="tap765ea7bc-21"/>
Dec 06 14:12:48 user nova-compute[75326]:     </interface>
Dec 06 14:12:48 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:12:48 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/console.log" append="off"/>
Dec 06 14:12:48 user nova-compute[75326]:     </serial>
Dec 06 14:12:48 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:12:48 user nova-compute[75326]:     <video>
Dec 06 14:12:48 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:12:48 user nova-compute[75326]:     </video>
Dec 06 14:12:48 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:12:48 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:12:48 user nova-compute[75326]:     </rng>
Dec 06 14:12:48 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:12:48 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:12:48 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:12:48 user nova-compute[75326]:     </memballoon>
Dec 06 14:12:48 user nova-compute[75326]:   </devices>
Dec 06 14:12:48 user nova-compute[75326]: </domain>
Dec 06 14:12:48 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20df1455-e5a7-5eef-afcb-d397eca117f6', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c7cf9-c42a-40bb-9e82-fc5c5da85130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap765ea7bc-21, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap765ea7bc-21, col_values=(('qos', UUID('1dd4285e-6a94-4936-b8d0-9e92c14ec819')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap765ea7bc-21, col_values=(('external_ids', {'iface-id': '765ea7bc-2156-4815-bede-834d676d7edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:df', 'vm-uuid': '7c41dda6-b0b1-44e3-8696-e085ff4f2bbf'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:48 user nova-compute[75326]: INFO os_vif [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130d2a6-d1e0-4857-89cb-94ff2318feee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:48 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:48 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 (non-flash)
Dec 06 14:12:48 user nova-compute[75326]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:12:48 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:12:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4312290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b308c43-2c4a-4446-b971-3b7f417598d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa8548-0654-4e95-bc4c-47c776c67a33]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c305ba14-bb3c-4986-82a8-2ee9074999aa]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce237d-9c3c-4e7e-904f-9518be01c9c7]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:12:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd91277-a7d6-4a89-bca2-9dffc8e8f533]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d20424-e313-49a8-8d3d-74503fea8063]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260]
Dec 06 14:12:49 user nova-compute[75326]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3, portal: 172.16.0.220,3260] successful.
Dec 06 14:12:49 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1d9f39-ed37-45ff-a0b8-f40e976444b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e33da8-0a2a-40a1-af3e-f215059566dc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== disconnect_volume: return (1158ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e411d1db-99a6-4573-9b28-f6c2c3b7bb90 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.592s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.902s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:50 user nova-compute[75326]: WARNING nova.compute.manager [req-518b4f06-8449-4b20-af5f-c772fe7e6fdb req-31b35bb6-5e62-4fb0-bd21-d934b7951390 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state resized and task_state resize_reverting.
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75326) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 14:12:50 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:51 user nova-compute[75326]: WARNING nova.compute.manager [req-d6bd9e25-f224-4b23-b3ca-0cad5284f21a req-4c2a36cb-93b3-4be4-8b86-94518c1e2607 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-unplugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state active and task_state powering-off.
Dec 06 14:12:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance destroyed successfully.
Dec 06 14:12:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:12:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2f402c58-59d7-4a5b-86a7-47740cf2abe1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.861s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:12:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance running successfully.
Dec 06 14:12:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] finish_revert_migration finished successfully. {{(pid=75326) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11866}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:52 user nova-compute[75326]: WARNING nova.compute.manager [req-a46d5ebe-15a6-43c4-a5d7-78a084cc554c req-0aba9f4a-1367-4438-9ab0-2eec2079e0c2 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state resized and task_state resize_reverting.
Dec 06 14:12:52 user nova-compute[75326]: INFO nova.compute.manager [None req-d216a706-8e4f-466f-9095-1f6868f34128 tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance to original state: 'active'
Dec 06 14:12:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:53 user nova-compute[75326]: WARNING nova.compute.manager [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state None.
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing instance network info cache due to event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updated VIF entry in instance network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e64007f9-55e2-4264-9520-7afd43523d1d req-1e6d25cf-6b36-4e06-b397-ff57abe51bad service nova] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:12:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:57 user nova-compute[75326]: INFO nova.compute.manager [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Shelving
Dec 06 14:12:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:57 user nova-compute[75326]: WARNING nova.compute.manager [req-10f9de07-7c3d-43a1-874e-1164cc48ffcb req-ed9c54f5-8a87-476d-bc67-ccf28d16dc8a service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state active and task_state shelving.
Dec 06 14:12:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance destroyed successfully.
Dec 06 14:12:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Beginning cold snapshot process
Dec 06 14:12:58 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:12:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk /opt/stack/data/nova/instances/snapshots/tmp55euaisu/73e823210a234ad68fdf5082c59272ef {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:12:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk /opt/stack/data/nova/instances/snapshots/tmp55euaisu/73e823210a234ad68fdf5082c59272ef" returned: 0 in 0.905s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:12:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Snapshot extracted, beginning image upload
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:59 user nova-compute[75326]: INFO nova.compute.manager [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Terminating instance
Dec 06 14:12:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:12:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:12:59 user nova-compute[75326]: WARNING nova.compute.manager [req-629f628a-7e6b-409e-ba43-e316b2dca471 req-d73b9fb9-371a-4bb7-9bd2-70a3ae850e78 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Instance destroyed successfully.
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lazy-loading 'resources' on Instance uuid b475687e-52b7-4cff-bc22-dbb8b732d1c6 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1022359840',display_name='tempest-VolumesAdminNegativeTest-server-1022359840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1022359840',id=6,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVkvG8YbDKG75LyWs3RX7KfYTdRds7DESXJ9naM6pTMkCz4VguPtg+amPp/2HHJJrzYshg+bTeABkRt8AqWYij2LieMakkCeto6KPEiRthZRL6cJV/nJBXi/W0km5owhw==',key_name='tempest-keypair-1641125632',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d51e81a50c4494a2ef06459b6ab745',ramdisk_id='',reservation_id='r-ujljwatl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-782371247',owner_user_name='tempest-VolumesAdminNegativeTest-782371247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fac47e105a4ce8af79f6d802ebb59e',uuid=b475687e-52b7-4cff-bc22-dbb8b732d1c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converting VIF {"id": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "address": "fa:16:3e:d9:25:d0", "network": {"id": "24954646-cd04-4807-b32f-6145e0ffa337", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1609286631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d51e81a50c4494a2ef06459b6ab745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5510da4c-bf", "ovs_interfaceid": "5510da4c-bf2a-4782-b0ab-7aff4db2e74d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG os_vif [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5510da4c-bf, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20cf075c-1da5-4e44-808a-ab1099a639d4) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:00 user nova-compute[75326]: INFO os_vif [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:25:d0,bridge_name='br-int',has_traffic_filtering=True,id=5510da4c-bf2a-4782-b0ab-7aff4db2e74d,network=Network(24954646-cd04-4807-b32f-6145e0ffa337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5510da4c-bf')
Dec 06 14:13:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Deleting instance files /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6_del
Dec 06 14:13:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Deletion of /opt/stack/data/nova/instances/b475687e-52b7-4cff-bc22-dbb8b732d1c6_del complete
Dec 06 14:13:00 user nova-compute[75326]: INFO nova.compute.manager [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 06 14:13:00 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:13:00 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:13:01 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:01 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Took 1.02 seconds to deallocate network for instance.
Dec 06 14:13:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-vif-unplugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] No waiting events found dispatching network-vif-unplugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:02 user nova-compute[75326]: WARNING nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received unexpected event network-vif-unplugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d for instance with vm_state deleted and task_state None.
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Acquiring lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] No waiting events found dispatching network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:02 user nova-compute[75326]: WARNING nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received unexpected event network-vif-plugged-5510da4c-bf2a-4782-b0ab-7aff4db2e74d for instance with vm_state deleted and task_state None.
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7f36d585-b1b5-48da-abc0-ae54bcf48581 req-c9dbd314-8fbd-4e0e-9bd0-1b8b5c9e8e9f service nova] [instance: b475687e-52b7-4cff-bc22-dbb8b732d1c6] Received event network-vif-deleted-5510da4c-bf2a-4782-b0ab-7aff4db2e74d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Snapshot image upload complete
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:02 user nova-compute[75326]: INFO nova.compute.manager [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Shelve offloading
Dec 06 14:13:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance destroyed successfully.
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:13:02 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Deleted allocations for instance b475687e-52b7-4cff-bc22-dbb8b732d1c6
Dec 06 14:13:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0873a8fc-c58e-4e95-854f-07c2d60b91fc tempest-VolumesAdminNegativeTest-782371247 tempest-VolumesAdminNegativeTest-782371247-project-member] Lock "b475687e-52b7-4cff-bc22-dbb8b732d1c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance destroyed successfully.
Dec 06 14:13:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'resources' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3sFuyyzk/u1BsOvoxYJHJzYzfvV/tbfuX4WOqFK41kPQDgOP3iSJqQ9JGWzgR4KoZAI6CTxMRFLHCmKrn+nmCZdDiugZYmnRwd5OmUBe5uIa6zBLN3K81LNegUcIKOPg==',key_name='tempest-keypair-1968467179',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:13:02.274976',shelved_host='user',shelved_image_id='d00ca6bf-95ec-4125-b4da-e35e21ce1d99'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG os_vif [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbafcbd3d-b6, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=309fcacd-bcd1-48ee-9ae7-3010e9e536b1) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:03 user nova-compute[75326]: INFO os_vif [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6')
Dec 06 14:13:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Deleting instance files /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387_del
Dec 06 14:13:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Deletion of /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387_del complete
Dec 06 14:13:03 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Deleted allocations for instance 125c9956-52f2-465f-98b2-c6a9501f6387
Dec 06 14:13:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'numa_topology' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.objects.base [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<125c9956-52f2-465f-98b2-c6a9501f6387> lazy-loaded attributes: resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing instance network info cache due to event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2c270319-3bf6-4a25-9eb7-55fef8002931 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.778s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updated VIF entry in instance network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9145dd12-add6-4bf8-8689-bfb1b6f51dd6 req-35b9a1d4-d7ff-4d9b-af6d-296677e0e666 service nova] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:13:18 user nova-compute[75326]: INFO nova.compute.claims [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Claim successful on node user
Dec 06 14:13:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:13:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.policy [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ea783d27940479b9d78a93500062e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56d8164e56e499c90eca8cb27e98bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:13:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Creating image(s)
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "/opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.076s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.223s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk 1073741824" returned: 0 in 0.061s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Successfully created port: a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:13:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Cannot resize image /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Ensure instance console log exists: /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Successfully updated port: a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquired lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-changed-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Refreshing instance network info cache due to event network-changed-a595c7bf-1a94-4df9-9f5e-b641dbace92c. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] Acquiring lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating instance_info_cache with network_info: [{"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Releasing lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Instance network_info: |[{"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] Acquired lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Refreshing network info cache for port a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Start _get_guest_xml network_info=[{"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:13:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911666535',display_name='tempest-AttachVolumeNegativeTest-server-1911666535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911666535',id=20,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC83jiu5VXDvLAvG4VTRMWZnq6S/MBw/SwBCDXItHw2iSSx7k6AoN0X3JZV4Eb4wtIGGs+YD0Z0RiQIpWA5vYUNabzP4uk6Ewt95AcqnP/nSCSkzoh1anLs+vrWBRwdlQA==',key_name='tempest-keypair-134796028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-2sxv3qp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=726a915c-ce0b-4759-b96b-a891e2876850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'pci_devices' on Instance uuid 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:13:20 user nova-compute[75326]:   <uuid>726a915c-ce0b-4759-b96b-a891e2876850</uuid>
Dec 06 14:13:20 user nova-compute[75326]:   <name>instance-00000014</name>
Dec 06 14:13:20 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:13:20 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:13:20 user nova-compute[75326]:   <metadata>
Dec 06 14:13:20 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:13:20 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1911666535</nova:name>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:13:20</nova:creationTime>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:13:20 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:13:20 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:owner>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:user uuid="6ea783d27940479b9d78a93500062e8e">tempest-AttachVolumeNegativeTest-1014509330-project-member</nova:user>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:project uuid="f56d8164e56e499c90eca8cb27e98bf9">tempest-AttachVolumeNegativeTest-1014509330</nova:project>
Dec 06 14:13:20 user nova-compute[75326]:       </nova:owner>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:13:20 user nova-compute[75326]:       <nova:ports>
Dec 06 14:13:20 user nova-compute[75326]:         <nova:port uuid="a595c7bf-1a94-4df9-9f5e-b641dbace92c">
Dec 06 14:13:20 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:13:20 user nova-compute[75326]:         </nova:port>
Dec 06 14:13:20 user nova-compute[75326]:       </nova:ports>
Dec 06 14:13:20 user nova-compute[75326]:     </nova:instance>
Dec 06 14:13:20 user nova-compute[75326]:   </metadata>
Dec 06 14:13:20 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:13:20 user nova-compute[75326]:     <system>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="serial">726a915c-ce0b-4759-b96b-a891e2876850</entry>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="uuid">726a915c-ce0b-4759-b96b-a891e2876850</entry>
Dec 06 14:13:20 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:13:20 user nova-compute[75326]:     </system>
Dec 06 14:13:20 user nova-compute[75326]:   </sysinfo>
Dec 06 14:13:20 user nova-compute[75326]:   <os>
Dec 06 14:13:20 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:13:20 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:13:20 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:13:20 user nova-compute[75326]:   </os>
Dec 06 14:13:20 user nova-compute[75326]:   <features>
Dec 06 14:13:20 user nova-compute[75326]:     <acpi/>
Dec 06 14:13:20 user nova-compute[75326]:     <apic/>
Dec 06 14:13:20 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:13:20 user nova-compute[75326]:   </features>
Dec 06 14:13:20 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:13:20 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:13:20 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:13:20 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:13:20 user nova-compute[75326]:   </clock>
Dec 06 14:13:20 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:13:20 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:13:20 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:13:20 user nova-compute[75326]:   </cpu>
Dec 06 14:13:20 user nova-compute[75326]:   <devices>
Dec 06 14:13:20 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:13:20 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:13:20 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk"/>
Dec 06 14:13:20 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:13:20 user nova-compute[75326]:     </disk>
Dec 06 14:13:20 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:13:20 user nova-compute[75326]:       <mac address="fa:16:3e:c0:dd:32"/>
Dec 06 14:13:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:13:20 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:13:20 user nova-compute[75326]:       <target dev="tapa595c7bf-1a"/>
Dec 06 14:13:20 user nova-compute[75326]:     </interface>
Dec 06 14:13:20 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:13:20 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/console.log" append="off"/>
Dec 06 14:13:20 user nova-compute[75326]:     </serial>
Dec 06 14:13:20 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:13:20 user nova-compute[75326]:     <video>
Dec 06 14:13:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:13:20 user nova-compute[75326]:     </video>
Dec 06 14:13:20 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:13:20 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:13:20 user nova-compute[75326]:     </rng>
Dec 06 14:13:20 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:13:20 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:13:20 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:13:20 user nova-compute[75326]:     </memballoon>
Dec 06 14:13:20 user nova-compute[75326]:   </devices>
Dec 06 14:13:20 user nova-compute[75326]: </domain>
Dec 06 14:13:20 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911666535',display_name='tempest-AttachVolumeNegativeTest-server-1911666535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911666535',id=20,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC83jiu5VXDvLAvG4VTRMWZnq6S/MBw/SwBCDXItHw2iSSx7k6AoN0X3JZV4Eb4wtIGGs+YD0Z0RiQIpWA5vYUNabzP4uk6Ewt95AcqnP/nSCSkzoh1anLs+vrWBRwdlQA==',key_name='tempest-keypair-134796028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-2sxv3qp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=726a915c-ce0b-4759-b96b-a891e2876850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG os_vif [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93d44e0c-1b4c-5c16-82d8-04228342cd56', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa595c7bf-1a, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa595c7bf-1a, col_values=(('qos', UUID('7457b38b-d2ec-4df4-b8e5-c2b02e3f8b03')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa595c7bf-1a, col_values=(('external_ids', {'iface-id': 'a595c7bf-1a94-4df9-9f5e-b641dbace92c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:dd:32', 'vm-uuid': '726a915c-ce0b-4759-b96b-a891e2876850'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:20 user nova-compute[75326]: INFO os_vif [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a')
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:c0:dd:32, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:13:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updated VIF entry in instance network info cache for port a595c7bf-1a94-4df9-9f5e-b641dbace92c. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:13:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating instance_info_cache with network_info: [{"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c0d3e31-ec94-43fd-8d0b-e90cdddf03d1 req-e03b37c6-1579-403c-b245-22c47f9c2b87 service nova] Releasing lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] No waiting events found dispatching network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:22 user nova-compute[75326]: WARNING nova.compute.manager [req-b80e4826-fb97-46b7-baf5-3584893a1c52 req-41da4914-7bbf-4458-82ac-62bd15b4c151 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received unexpected event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c for instance with vm_state building and task_state spawning.
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:13:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Instance spawned successfully.
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:13:24 user nova-compute[75326]: INFO nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Took 5.09 seconds to spawn the instance on the hypervisor.
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:13:24 user nova-compute[75326]: INFO nova.compute.manager [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Took 5.85 seconds to build instance.
Dec 06 14:13:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c69c99da-b33c-41ec-9f28-c4a2b675dbb8 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.942s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] No waiting events found dispatching network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:24 user nova-compute[75326]: WARNING nova.compute.manager [req-f2037076-7c67-4d6f-bb11-819ced1c118e req-12a9d88a-1a1c-4f3c-b20b-889bdbe823e8 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received unexpected event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c for instance with vm_state active and task_state None.
Dec 06 14:13:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-changed-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Refreshing instance network info cache due to event network-changed-4ed35278-449c-4899-8047-1943cf41e4ea. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] Acquiring lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] Acquired lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Refreshing network info cache for port 4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updated VIF entry in instance network info cache for port 4ed35278-449c-4899-8047-1943cf41e4ea. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating instance_info_cache with network_info: [{"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-645dc87d-de5a-4b68-b2ad-08aeda13f27e req-5bfc50e5-b0b1-4db3-be62-571b53953fce service nova] Releasing lock "refresh_cache-878463cf-3b96-45ab-a0c7-016de78c16c9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:31 user nova-compute[75326]: INFO nova.compute.manager [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attaching volume 087f08f1-46b9-4a66-9071-6cba21dbec39 to /dev/vdb
Dec 06 14:13:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:31 user nova-compute[75326]: DEBUG os_brick.utils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379b55e-b91f-4b7b-b130-14f76871e45a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=25.582359313964844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f3779-49fa-40da-929d-81ebe86138cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[605487c4-afe1-43b3-b3c0-cdfd2b98a5f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e3f5ae-bcd8-4704-9ce4-0cfa95871756]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:32 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb5531a-b66c-491b-a1f4-7354b39641b1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG os_brick.utils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== get_connector_properties: return (481ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating existing volume attachment record: b46df12a-828c-4235-82a4-a4680cf9d333 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e6a3e818-01b6-489c-a351-181a1d84394c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 878463cf-3b96-45ab-a0c7-016de78c16c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb35ede4-8060-4d88-9fcf-0affecd71acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 726a915c-ce0b-4759-b96b-a891e2876850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:13:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:13:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-changed-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Refreshing instance network info cache due to event network-changed-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] Acquiring lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] Acquired lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Refreshing network info cache for port ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lazy-loading 'flavor' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updated VIF entry in instance network info cache for port ddbdcd98-aa19-4ed6-98ab-2a348f32b5df. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updating instance_info_cache with network_info: [{"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07bc49d3-925c-4ce6-af7e-9c0c1ad86cf8 req-67c7949f-9def-47e7-bab2-ff3afb025b4a service nova] Releasing lock "refresh_cache-bb35ede4-8060-4d88-9fcf-0affecd71acd" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:35 user nova-compute[75326]: INFO nova.compute.manager [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attaching volume bde2d497-9cfe-4c08-b28b-b5308d69af02 to /dev/vdb
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.utils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cb32a-12df-47bb-b2fc-d771599a1a45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c89a0f-1ec0-4ef7-9ee9-cb44cda62964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2501357-651d-4b08-816b-5c3b57389144]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7150f7a6-c3c1-4331-b3c9-e70be0ffa1cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:35 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:13:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff92ec-4cd2-4149-9567-22c8f0a12a25]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG os_brick.utils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updating existing volume attachment record: 747eca48-8f79-47b0-b6be-138fdd5b5e23 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:13:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:38 user nova-compute[75326]: INFO nova.compute.manager [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Rescuing
Dec 06 14:13:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:39 user nova-compute[75326]: WARNING nova.compute.manager [req-e926f4e5-2808-4fb6-b4d9-66a897732ef1 req-441b4e1b-1a89-4100-a4aa-51c52cbcbb2c service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state active and task_state rescuing.
Dec 06 14:13:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance destroyed successfully.
Dec 06 14:13:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Attempting rescue
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:13:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Creating image(s)
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.413s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'migration_context' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.base [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<82db1a45-6725-46c9-9359-cf1b0cb90e65> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start _get_guest_xml network_info=[{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:e7:8b:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.base [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<82db1a45-6725-46c9-9359-cf1b0cb90e65> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'numa_topology' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.base [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<82db1a45-6725-46c9-9359-cf1b0cb90e65> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.base [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<82db1a45-6725-46c9-9359-cf1b0cb90e65> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-786413736',display_name='tempest-ServerRescueNegativeTestJSON-server-786413736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-786413736',id=19,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-aizogry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:58Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=82db1a45-6725-46c9-9359-cf1b0cb90e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:e7:8b:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:e7:8b:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:40 user nova-compute[75326]: DEBUG nova.objects.base [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<82db1a45-6725-46c9-9359-cf1b0cb90e65> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:13:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:13:40 user nova-compute[75326]:   <uuid>82db1a45-6725-46c9-9359-cf1b0cb90e65</uuid>
Dec 06 14:13:40 user nova-compute[75326]:   <name>instance-00000013</name>
Dec 06 14:13:40 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:13:40 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:13:40 user nova-compute[75326]:   <metadata>
Dec 06 14:13:40 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:13:40 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-786413736</nova:name>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:13:39</nova:creationTime>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:13:40 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:13:40 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:owner>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:13:40 user nova-compute[75326]:       </nova:owner>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:13:40 user nova-compute[75326]:       <nova:ports>
Dec 06 14:13:40 user nova-compute[75326]:         <nova:port uuid="e8a2b804-acb0-429f-bfbc-3b0db45e811d">
Dec 06 14:13:40 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:13:40 user nova-compute[75326]:         </nova:port>
Dec 06 14:13:40 user nova-compute[75326]:       </nova:ports>
Dec 06 14:13:40 user nova-compute[75326]:     </nova:instance>
Dec 06 14:13:40 user nova-compute[75326]:   </metadata>
Dec 06 14:13:40 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:13:40 user nova-compute[75326]:     <system>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="serial">82db1a45-6725-46c9-9359-cf1b0cb90e65</entry>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="uuid">82db1a45-6725-46c9-9359-cf1b0cb90e65</entry>
Dec 06 14:13:40 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:13:40 user nova-compute[75326]:     </system>
Dec 06 14:13:40 user nova-compute[75326]:   </sysinfo>
Dec 06 14:13:40 user nova-compute[75326]:   <os>
Dec 06 14:13:40 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:13:40 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:13:40 user nova-compute[75326]:   </os>
Dec 06 14:13:40 user nova-compute[75326]:   <features>
Dec 06 14:13:40 user nova-compute[75326]:     <acpi/>
Dec 06 14:13:40 user nova-compute[75326]:     <apic/>
Dec 06 14:13:40 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:13:40 user nova-compute[75326]:   </features>
Dec 06 14:13:40 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:13:40 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:13:40 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:13:40 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:13:40 user nova-compute[75326]:   </clock>
Dec 06 14:13:40 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:13:40 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:13:40 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:13:40 user nova-compute[75326]:   </cpu>
Dec 06 14:13:40 user nova-compute[75326]:   <devices>
Dec 06 14:13:40 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:13:40 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:13:40 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue"/>
Dec 06 14:13:40 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:13:40 user nova-compute[75326]:     </disk>
Dec 06 14:13:40 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:13:40 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:13:40 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk"/>
Dec 06 14:13:40 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:13:40 user nova-compute[75326]:     </disk>
Dec 06 14:13:40 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:13:40 user nova-compute[75326]:       <mac address="fa:16:3e:e7:8b:25"/>
Dec 06 14:13:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:13:40 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:13:40 user nova-compute[75326]:       <target dev="tape8a2b804-ac"/>
Dec 06 14:13:40 user nova-compute[75326]:     </interface>
Dec 06 14:13:40 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:13:40 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/console.log" append="off"/>
Dec 06 14:13:40 user nova-compute[75326]:     </serial>
Dec 06 14:13:40 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:13:40 user nova-compute[75326]:     <video>
Dec 06 14:13:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:13:40 user nova-compute[75326]:     </video>
Dec 06 14:13:40 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:13:40 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:13:40 user nova-compute[75326]:     </rng>
Dec 06 14:13:40 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:13:40 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:13:40 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:13:40 user nova-compute[75326]:     </memballoon>
Dec 06 14:13:40 user nova-compute[75326]:   </devices>
Dec 06 14:13:40 user nova-compute[75326]: </domain>
Dec 06 14:13:40 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:13:40 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance destroyed successfully.
Dec 06 14:13:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:e7:8b:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:13:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:41 user nova-compute[75326]: WARNING nova.compute.manager [req-939d319f-341a-44e2-8932-3f71c147eb3d req-1abfb47f-37ba-4fe0-ac44-cb278609f7f7 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state active and task_state rescuing.
Dec 06 14:13:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNpQZxWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:13:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:13:42 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e057a-b6ed-4f29-8b6c-4210daf33bf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:13:42 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559137a-dc66-41a9-b97f-d0a89c23b7f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39] added
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9a79c-430e-4916-b3e7-668998cf6b3a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.139s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5154db6-510c-4497-a0b4-f7c025debe68]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNpQZxWd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNpQZxWd" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb0e30-565e-453b-a7ec-483ee8abb6d3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNpQZxWd'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12025bf0-a6c4-430c-b55a-da2973b58804]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71069ea-f8fd-4435-9855-bb731cdc3de6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c610b5ab-24ff-422b-a87e-b5532562c52f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260]
Dec 06 14:13:42 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260] successful.
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abaef68-4ca8-4a6a-ae6a-f752ee3716e6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eacc89d-34ad-4ac2-8f11-b123e325f1c0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d40b3-16c2-45bd-b1ca-02708d61ced4]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:13:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNpQZxWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:43 user nova-compute[75326]: INFO nova.compute.manager [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Terminating instance
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state active and task_state rescuing.
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe38334b-5e7b-4813-b4ca-19b0d686edb6 req-ee0a60fb-c142-4a86-87bc-d28da45b8371 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state active and task_state rescuing.
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c6bf1421-70a3-43bc-b57b-905bb45fc77d tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:13:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Instance destroyed successfully.
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lazy-loading 'resources' on Instance uuid e6a3e818-01b6-489c-a351-181a1d84394c {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12907677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1357608647',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMEGyuxu29ECOt7EUBzV7kT2dbGNn+AVr2vrcUadCvT/I3GiHjvE9GrIJsiBV8ft595+uRrRtq9Plu+wyZ3fzkQiL5PwHY5TUM+KIsLWHMlghbWIZsnTAPJQ93Ovm5Dhw==',key_name='tempest-keypair-1868666262',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54d98376fb5a46db9dc51d8e158a99e1',ramdisk_id='',reservation_id='r-mh8anguf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1067262843',owner_user_name='tempest-ServerActionsV293TestJSON-1067262843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11d9a8432cf4fc89535615a3cb0d12b',uuid=e6a3e818-01b6-489c-a351-181a1d84394c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converting VIF {"id": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "address": "fa:16:3e:f3:32:4c", "network": {"id": "b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-819430288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d98376fb5a46db9dc51d8e158a99e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a206a-f7", "ovs_interfaceid": "138a206a-f7fa-41a9-aaf1-49fd5f4815df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_vif [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138a206a-f7, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '26263356239663339', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263356239663339', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d333384-e496-4db7-8a1f-64b270d72181) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:43 user nova-compute[75326]: INFO os_vif [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:32:4c,bridge_name='br-int',has_traffic_filtering=True,id=138a206a-f7fa-41a9-aaf1-49fd5f4815df,network=Network(b3f9c3dc-b8a0-40a7-9711-cfccfa8cfb82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a206a-f7')
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcaOsKlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:43 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:13:43 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:13:43 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:13:43 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:13:43 user nova-compute[75326]:   <serial>087f08f1-46b9-4a66-9071-6cba21dbec39</serial>
Dec 06 14:13:43 user nova-compute[75326]: </disk>
Dec 06 14:13:43 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fceec68-c0e3-4202-a8e4-1500e56eece2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:13:44 user nova-compute[75326]: No targets found.
Dec 06 14:13:44 user nova-compute[75326]: iSNS:
Dec 06 14:13:44 user nova-compute[75326]: No targets found.
Dec 06 14:13:44 user nova-compute[75326]: STATIC:
Dec 06 14:13:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:13:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:13:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:13:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:13:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:13:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:13:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d
Dec 06 14:13:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:13:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:13:44 user nova-compute[75326]: FIRMWARE:
Dec 06 14:13:44 user nova-compute[75326]: No targets found.
Dec 06 14:13:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:13:44 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:13:44 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b96b89-0818-4f61-b35d-1b7f201c53ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de24503-7916-4baa-8f33-511994a06ad5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:44 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:44 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d (non-flash)
Dec 06 14:13:44 user nova-compute[75326]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:44 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44efbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c3f36-d98a-4e1b-9713-bd11e9254674]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfc45ed-ce89-4356-a572-a4df1a0a6a64]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8df418e-05c9-49a2-b9b0-b6a2dbc479ca]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e3785-3f56-4fe2-b4a6-ce6381aa50ba]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdbbda2b-7badebcbd88b7287', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dbbda2b', '/dev/disk/by-id/scsi-23762616465626362') {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cbfc7-d823-432d-b855-0c90aa2a428c]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76de8f-76f4-4e3b-a921-08790bd5a9af]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f302c-fc03-42a8-86f0-ea29ec710def]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260]
Dec 06 14:13:44 user nova-compute[75326]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d, portal: 172.16.0.220,3260] successful.
Dec 06 14:13:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a6b7be-a953-441b-9861-af13a9703c9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff91ae-f653-4ae3-a477-0a9a76aa4125]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:13:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deleting instance files /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c_del
Dec 06 14:13:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deletion of /opt/stack/data/nova/instances/e6a3e818-01b6-489c-a351-181a1d84394c_del complete
Dec 06 14:13:44 user nova-compute[75326]: INFO nova.compute.manager [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Took 1.29 seconds to destroy the instance on the hypervisor.
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No VIF found with MAC fa:16:3e:2e:98:af, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:13:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91e71549-8ca8-4b46-b992-5ad2adc0598e tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.969s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-unplugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Acquiring lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] Lock "e6a3e818-01b6-489c-a351-181a1d84394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] No waiting events found dispatching network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:13:45 user nova-compute[75326]: WARNING nova.compute.manager [req-55abcd80-020e-4256-b1f4-1600bc0baea9 req-fd935d05-0bf6-48fe-947a-889c72402ca2 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received unexpected event network-vif-plugged-138a206a-f7fa-41a9-aaf1-49fd5f4815df for instance with vm_state active and task_state deleting.
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:13:45 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Took 1.03 seconds to deallocate network for instance.
Dec 06 14:13:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-0835f387-675d-4d95-98f6-a18f49f8078a req-2af01221-d230-4e6b-a1ed-6b73ef01b642 service nova] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Received event network-vif-deleted-138a206a-f7fa-41a9-aaf1-49fd5f4815df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:13:46 user nova-compute[75326]: INFO nova.compute.manager [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Took 0.83 seconds to detach 1 volumes for instance.
Dec 06 14:13:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] [instance: e6a3e818-01b6-489c-a351-181a1d84394c] Deleting volume: 95a6b7be-a953-441b-9861-af13a9703c9d {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:46 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:13:46 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:13:46 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44b6b0-1163-4122-aaed-6c84ebb27665]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:13:46 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc08682-39aa-4ab0-8a68-f9b9547ab088]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02] added
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5fa2d-57f4-4e5d-95f9-444736138050]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf39f1-ba05-48b5-bc52-525c078f9c01]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWnzlHuo {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWnzlHuo" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c68bc7-cb83-4793-a8e8-1c696619909a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZWnzlHuo'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8ff355-ba5e-4fe2-aa51-90accf971a78]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed9182-a059-46ce-8c79-19aa13a7b1ff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eacc334-1c6a-4152-8d83-f8e663e196a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]
Dec 06 14:13:46 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ccb05-4a6c-4b38-8676-a51128af2aa8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ec7d06-f0d5-449c-84ed-49d27f6c02aa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:13:46 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[58250a43-84fe-4650-a201-17318c3fe56f]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:13:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:46 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Deleted allocations for instance e6a3e818-01b6-489c-a351-181a1d84394c
Dec 06 14:13:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6449cb9b-bc96-48ce-ac15-c8e9ab700430 tempest-ServerActionsV293TestJSON-1067262843 tempest-ServerActionsV293TestJSON-1067262843-project-member] Lock "e6a3e818-01b6-489c-a351-181a1d84394c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.924s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:13:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26563343133663339', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563343133663339', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:13:47 user nova-compute[75326]: DEBUG nova.objects.instance [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lazy-loading 'flavor' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:13:47 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:13:47 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:13:47 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:13:47 user nova-compute[75326]:   <serial>bde2d497-9cfe-4c08-b28b-b5308d69af02</serial>
Dec 06 14:13:47 user nova-compute[75326]: </disk>
Dec 06 14:13:47 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] No VIF found with MAC fa:16:3e:20:a8:0b, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-59f116bb-3d29-489d-b5c2-ec93d9c45007 tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.889s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG nova.objects.instance [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:13:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:49 user nova-compute[75326]: INFO nova.compute.manager [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attaching volume 48cbb1ce-650a-4f27-9e5f-0661a22c38b8 to /dev/vdc
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.utils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae210310-6bf1-454c-af8a-b689f297e3e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402d3ed-1340-4bfd-8b40-36dbbee8c0b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b7b61-597e-4602-86cf-4daadd44b8c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fed5866-01a6-4142-91dc-5a43319bc61f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.utils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:49 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca6ef2-c794-4457-8b13-cf98b722504d]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.utils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating existing volume attachment record: 21e9496d-aaaa-488a-92dd-99685b19477f {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[631ec06b-d886-4694-90db-8e33c10381ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[754f60ee-cd20-49b9-bfd3-de77a0458a53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d361078-d573-48c5-ac5c-a14d5859cc85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd30dc-2b85-4269-a060-9b0187b8eecd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:13:49 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:13:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726602f-043b-4c82-ae2d-bf2da71e16e7]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:13:49 user nova-compute[75326]: DEBUG os_brick.utils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:13:49 user nova-compute[75326]: INFO nova.compute.manager [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Swapping volume bde2d497-9cfe-4c08-b28b-b5308d69af02 for 6c7607a3-2e7d-413e-8775-a905d48c5390
Dec 06 14:13:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:13:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLBhGXNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:00 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:00 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:00 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4b408-c186-4c91-9383-c111d8ab293e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:14:00 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7503d63-dcdc-4071-a11f-a06b4592dd8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8] added
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c85adf-83bb-4fda-8e32-3eee726d2f92]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7808b05-e32f-4846-b625-c53be147afe6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLBhGXNV {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLBhGXNV" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7d494-ce23-4add-b7b5-9e2498cf9593]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zLBhGXNV'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d2e98-02a2-4d08-8040-6ad39216b9cf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15bd2df-7bdb-4eb9-b9b6-ca822cacb266]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc62e977-973c-44ed-8bdb-1bc213c84951]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260]
Dec 06 14:14:00 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7d8f13-e848-4505-bc42-03f993d8ca1a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9447b26-2035-452b-8dd1-7cd0e7c7ef22]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc71c5-d244-412e-9b9b-46c4b9708a7f]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390', 'serial': '6c7607a3-2e7d-413e-8775-a905d48c5390'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bde2d497-9cfe-4c08-b28b-b5308d69af02', 'serial'} {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:00 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLBhGXNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23464663039333363', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464663039333363', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.966s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:01 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:01 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c086e0-32a0-440c-a3f4-062f6d0a9ac9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:14:01 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:14:01 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:01 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:14:01 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:14:01 user nova-compute[75326]:   <serial>48cbb1ce-650a-4f27-9e5f-0661a22c38b8</serial>
Dec 06 14:14:01 user nova-compute[75326]: </disk>
Dec 06 14:14:01 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adee2a6-970a-4ca9-b30c-3b9a7287acdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390] added
Dec 06 14:14:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64874321-5926-492b-bb8f-8394a0b803fa]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e4098b-7d2e-4fd9-97b6-5d467bfb7130]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkhCpbFn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkhCpbFn" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd36e20-e252-4b53-a431-4789abca45e8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkhCpbFn'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1096197e-3f9c-47b2-8123-3bfc17c8f64a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82c4ba-5bb0-491a-89fa-7ee24fecd9ac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f437aa-c44f-4f86-859c-bed75120d569]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260]
Dec 06 14:14:02 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e450c-b46c-408d-9a0b-9721feef1913]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830676e-2f96-4a2a-a3bf-680255bb2201]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[055b225e-304d-461b-aa64-c9f510398595]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] No VIF found with MAC fa:16:3e:2e:98:af, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:14:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-450cb5a3-7370-4f5a-8660-1df51ed7c5c3 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.958s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== connect_volume: return (2287ms) {'type': 'block', 'scsi_wwn': '23064343964313532', 'path': '/dev/sdf'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064343964313532', 'path': '/dev/sdf'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lazy-loading 'flavor' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 55574528 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:04 user nova-compute[75326]: INFO nova.compute.manager [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Detaching volume 48cbb1ce-650a-4f27-9e5f-0661a22c38b8
Dec 06 14:14:04 user nova-compute[75326]: INFO nova.virt.block_device [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attempting to driver detach volume 48cbb1ce-650a-4f27-9e5f-0661a22c38b8 from mountpoint /dev/vdc
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Attempting to detach device vdc from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:04 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:04 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:14:04 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:14:04 user nova-compute[75326]:   <serial>48cbb1ce-650a-4f27-9e5f-0661a22c38b8</serial>
Dec 06 14:14:04 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:14:04 user nova-compute[75326]: </disk>
Dec 06 14:14:04 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:04 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully detached device vdc from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the persistent domain config.
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:04 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:04 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:14:04 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:14:04 user nova-compute[75326]:   <serial>48cbb1ce-650a-4f27-9e5f-0661a22c38b8</serial>
Dec 06 14:14:04 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:14:04 user nova-compute[75326]: </disk>
Dec 06 14:14:04 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 226492416 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:14:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 568328192 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 743440384 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:07 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1036ab19-127b-421c-aa5f-1caae17bf47d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:14:07 user nova-compute[75326]: No targets found.
Dec 06 14:14:07 user nova-compute[75326]: iSNS:
Dec 06 14:14:07 user nova-compute[75326]: No targets found.
Dec 06 14:14:07 user nova-compute[75326]: STATIC:
Dec 06 14:14:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:14:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390
Dec 06 14:14:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:14:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8
Dec 06 14:14:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:07 user nova-compute[75326]: FIRMWARE:
Dec 06 14:14:07 user nova-compute[75326]: No targets found.
Dec 06 14:14:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:14:07 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:14:07 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef3160-4697-49c1-973d-8e352aa2191d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a467b931-9e0a-461b-8508-069653fbb70b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43132e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c7e8ba-4b88-49e5-8d7e-44833cace99e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14841d3-c7a5-4e39-9bbc-d599e3f91c9b]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b67550-a50a-40be-aae5-baee8313b091]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71c1db-9e73-4b7c-9d8e-3b9f39e1dd63]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002a0d4-fa78-4f5b-b0f3-e89253f6bba7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b93db5-08c6-4358-b242-0a642bd76128]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]
Dec 06 14:14:07 user nova-compute[75326]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed124844-19d0-4fbd-a3ef-8b18f87dae09]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== disconnect_volume: return (315ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390', 'serial'} {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 14:14:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: removing Cinder connection for volume bde2d497-9cfe-4c08-b28b-b5308d69af02 {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 14:14:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: Updating volume bde2d497-9cfe-4c08-b28b-b5308d69af02 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rkhCpbFn", "auth_password": "q5CUcyDE8aWbXB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "6c7607a3-2e7d-413e-8775-a905d48c5390"}, "status": "reserved", "instance": "bb35ede4-8060-4d88-9fcf-0affecd71acd", "attached_at": "", "detached_at": "", "volume_id": "6c7607a3-2e7d-413e-8775-a905d48c5390", "serial": "6c7607a3-2e7d-413e-8775-a905d48c5390"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390', 'no_device': None, 'attachment_id': '62671f7b-a47a-48d5-8ff5-a6fec0f3f250'} {{(pid=75326) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 14:14:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47940e0d-d849-4afe-8abf-375db76925d3 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.967s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.utils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5579f98-38d7-48b9-b6cd-9c41979b7437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[869326ea-4397-46f3-ad45-b9ead8a94b29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13725f-b4fe-4e5f-9ef5-3257c3b9b0f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98837b36-22d7-4531-911b-80ebd14176a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:10 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:14:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbb4f3-6c3c-4744-bde6-5c196198c5e5]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:14:10 user nova-compute[75326]: DEBUG os_brick.utils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:10 user nova-compute[75326]: INFO nova.compute.manager [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Swapping volume 6c7607a3-2e7d-413e-8775-a905d48c5390 for bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bde2d497-9cfe-4c08-b28b-b5308d69af02', 'serial': 'bde2d497-9cfe-4c08-b28b-b5308d69af02'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390'}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390', 'serial'} {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:20 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f03c7aa-c277-4583-8db9-8b47613d6596]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:14:20 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec076b57-a760-4488-ae7f-f7ea8104fb06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02] added
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11052d-0a3a-47f3-ac4e-75a65a075542]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb28b1b0-0159-4cae-985f-686d3699f0a0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWnzlHuo {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWnzlHuo" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7879068-67b6-4b12-8376-06eb4f901bca]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZWnzlHuo'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1129ae-11f7-4926-b10c-2d9d8dcaea02]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e4392-5526-427c-9a98-b413e8e14aaa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c531be5-cf29-4795-8ace-2364c616d6c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]
Dec 06 14:14:20 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[091dc75b-b98d-47b1-b619-b52210807078]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[282af4fb-6b5e-4e7a-a1e6-79e7629e9ee6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[53afbee7-f49d-4224-a9ab-1184682ebacc]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26563343133663339', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563343133663339', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:14:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lazy-loading 'flavor' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 116391936 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 374341632 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 463470592 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:24 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 is timed out.
Dec 06 14:14:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully detached device vdc from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the live domain config.
Dec 06 14:14:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLBhGXNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:24 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d58530-8a92-4676-a109-4a35efdc0c3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:14:24 user nova-compute[75326]: No targets found.
Dec 06 14:14:24 user nova-compute[75326]: iSNS:
Dec 06 14:14:24 user nova-compute[75326]: No targets found.
Dec 06 14:14:24 user nova-compute[75326]: STATIC:
Dec 06 14:14:24 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:24 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:24 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:24 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:14:24 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:24 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:24 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390
Dec 06 14:14:24 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:24 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:24 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:14:24 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:24 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:24 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8
Dec 06 14:14:24 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:24 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:24 user nova-compute[75326]: FIRMWARE:
Dec 06 14:14:24 user nova-compute[75326]: No targets found.
Dec 06 14:14:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:14:24 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:14:24 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a30763-4062-486e-91f6-3e1c7769d8a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb3462-16ee-4337-8d5b-75685d17aec1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4311c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[978a1e10-9083-45f6-abbb-50e4e154e279]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d2852f-fb78-47f6-a260-737efeac1108]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83a297b-3c84-4501-82e9-8f9ec6eecf66]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:14:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105c25a-f9de-4c43-8e72-788645f62ed2]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4d837-b5d1-4dc1-9d36-4b5e0af0ce23]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb261d0-87a9-46c3-9b7c-054039c38bca]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260]
Dec 06 14:14:25 user nova-compute[75326]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cbb1ce-650a-4f27-9e5f-0661a22c38b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e36b3-f56b-4c41-86bc-d614ad564b09]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== disconnect_volume: return (385ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-646ba438-d9c2-4aa3-bad5-57dd172cb99d tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.381s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkhCpbFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6c7607a3-2e7d-413e-8775-a905d48c5390'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17103c4d-c9ae-4574-a1d7-1467988b4003]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:14:26 user nova-compute[75326]: No targets found.
Dec 06 14:14:26 user nova-compute[75326]: iSNS:
Dec 06 14:14:26 user nova-compute[75326]: No targets found.
Dec 06 14:14:26 user nova-compute[75326]: STATIC:
Dec 06 14:14:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:14:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390
Dec 06 14:14:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:14:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:26 user nova-compute[75326]: FIRMWARE:
Dec 06 14:14:26 user nova-compute[75326]: No targets found.
Dec 06 14:14:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:14:26 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:14:26 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06263d0-4df0-4a40-b886-ae012ec00ece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd551a3-caf7-437f-b962-92f9b4a80f77]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd43d2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390'): ({'sdf'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Removing single pathed devices sdf {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[126c3aaa-ef22-4925-be7b-17c0de09891a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[004232e4-07eb-4c48-b098-b0300b3edd88]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Flushing IO for device /dev/sdf {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2691aeae-8392-4f81-b03b-be103bcd7596]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:14:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[022dad41-5681-489e-bd0e-adb43c857258]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b5f2e-27ce-4890-b86b-885e4c0b8b28]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f946c7-7803-4dde-8e93-b555291e9e21]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260]
Dec 06 14:14:27 user nova-compute[75326]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c7607a3-2e7d-413e-8775-a905d48c5390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2fed30-deaa-4a67-acf4-e57c128650f0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] <== disconnect_volume: return (372ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bb35ede4-8060-4d88-9fcf-0affecd71acd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bde2d497-9cfe-4c08-b28b-b5308d69af02', 'serial'} {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 14:14:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: removing Cinder connection for volume 6c7607a3-2e7d-413e-8775-a905d48c5390 {{(pid=75326) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] swap_volume: Updating volume 6c7607a3-2e7d-413e-8775-a905d48c5390 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ZWnzlHuo", "auth_password": "NQGdz0k2sILJRg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "bde2d497-9cfe-4c08-b28b-b5308d69af02"}, "status": "reserved", "instance": "bb35ede4-8060-4d88-9fcf-0affecd71acd", "attached_at": "", "detached_at": "", "volume_id": "bde2d497-9cfe-4c08-b28b-b5308d69af02", "serial": "bde2d497-9cfe-4c08-b28b-b5308d69af02"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bde2d497-9cfe-4c08-b28b-b5308d69af02', 'no_device': None, 'attachment_id': 'd7513353-e92b-4f9f-a8b0-3990ad45fee8'} {{(pid=75326) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-947e2211-8a6a-45ef-9f57-f3c4cc516d71 tempest-TestVolumeSwap-1844313942 tempest-TestVolumeSwap-1844313942-project-admin] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.007s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:29 user nova-compute[75326]: INFO nova.compute.manager [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Detaching volume bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:29 user nova-compute[75326]: INFO nova.virt.block_device [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Attempting to driver detach volume bde2d497-9cfe-4c08-b28b-b5308d69af02 from mountpoint /dev/vdb
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Attempting to detach device vdb from instance bb35ede4-8060-4d88-9fcf-0affecd71acd from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:29 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:29 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:14:29 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:14:29 user nova-compute[75326]:   <serial>bde2d497-9cfe-4c08-b28b-b5308d69af02</serial>
Dec 06 14:14:29 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:14:29 user nova-compute[75326]: </disk>
Dec 06 14:14:29 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Successfully detached device vdb from instance bb35ede4-8060-4d88-9fcf-0affecd71acd from the persistent domain config.
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb35ede4-8060-4d88-9fcf-0affecd71acd from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:29 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:29 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:14:29 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:14:29 user nova-compute[75326]:   <serial>bde2d497-9cfe-4c08-b28b-b5308d69af02</serial>
Dec 06 14:14:29 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:14:29 user nova-compute[75326]: </disk>
Dec 06 14:14:29 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:14:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7922MB free_disk=25.532962799072266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 878463cf-3b96-45ab-a0c7-016de78c16c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb35ede4-8060-4d88-9fcf-0affecd71acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 726a915c-ce0b-4759-b96b-a891e2876850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:14:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:14:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid 8b318cff-3431-45bf-8712-ea2d1cd59e3a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:14:34 user nova-compute[75326]: INFO nova.compute.claims [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Claim successful on node user
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updating instance_info_cache with network_info: [{"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-8b318cff-3431-45bf-8712-ea2d1cd59e3a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:14:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:14:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:14:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:14:35 user nova-compute[75326]: INFO nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Booting with volume 044c5aee-640b-4e95-a242-f779ac74a20e at /dev/vda
Dec 06 14:14:35 user nova-compute[75326]: DEBUG nova.policy [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad63ce1fea1b43ce92d4261a1a8ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09066ffaa044edfbcd83596cb8fdc28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee4b37-32f5-4e80-a4c9-7b682d35aec0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a4f88-1362-4e06-aa11-71b74bba36f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84524e41-7152-4d5c-947a-52241a078bbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d88b3a-efab-49e1-a0bd-70aa35f6d3e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:35 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:14:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e354a20-a455-4263-8932-2d8b328bd272]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating existing volume attachment record: 295ba025-e7f4-492a-b545-4f8ed9252cef {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:14:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully created port: b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:14:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully created port: c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:14:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully created port: 0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:14:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully created port: 5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:14:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully created port: f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-b2e6387d-91f5-4eb8-9e89-df1eae2757b7. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG nova.network.neutron [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG nova.network.neutron [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:39 user nova-compute[75326]: DEBUG nova.network.neutron [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-060065fb-2d31-4154-8a77-b281d85f7afa req-9cda0467-dc96-4693-8069-fdb2c19c6848 service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:39 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: 44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port 44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-c95fcd04-a3c2-4d59-afb9-09e39d4a6056. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f66e1b02-a6d2-413a-943c-fe625b2b9854 req-a000fa4b-e320-4659-be8a-051439554287 service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'info_cache' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: 0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance destroyed successfully.
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'resources' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG os_vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9cd70bf-7e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eac99e94-b6fe-4385-b5ba-81956787cead) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:42 user nova-compute[75326]: INFO os_vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start _get_guest_xml network_info=[{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'numa_topology' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:42 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:14:42 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'pci_devices' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:14:42 user nova-compute[75326]:   <uuid>7007fec3-20a9-408b-ac10-067919ebab46</uuid>
Dec 06 14:14:42 user nova-compute[75326]:   <name>instance-00000003</name>
Dec 06 14:14:42 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:14:42 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:14:42 user nova-compute[75326]:   <metadata>
Dec 06 14:14:42 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:14:42 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeTestJSON-server-1364634591</nova:name>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:14:42</nova:creationTime>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:14:42 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:14:42 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:owner>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:user uuid="691bec5c3db54e5d8bedc6193b976c01">tempest-AttachVolumeTestJSON-653396495-project-member</nova:user>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:project uuid="83c49428c1da4c6592df6be7874c46f7">tempest-AttachVolumeTestJSON-653396495</nova:project>
Dec 06 14:14:42 user nova-compute[75326]:       </nova:owner>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:14:42 user nova-compute[75326]:       <nova:ports>
Dec 06 14:14:42 user nova-compute[75326]:         <nova:port uuid="b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1">
Dec 06 14:14:42 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:14:42 user nova-compute[75326]:         </nova:port>
Dec 06 14:14:42 user nova-compute[75326]:       </nova:ports>
Dec 06 14:14:42 user nova-compute[75326]:     </nova:instance>
Dec 06 14:14:42 user nova-compute[75326]:   </metadata>
Dec 06 14:14:42 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:14:42 user nova-compute[75326]:     <system>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="serial">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="uuid">7007fec3-20a9-408b-ac10-067919ebab46</entry>
Dec 06 14:14:42 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:14:42 user nova-compute[75326]:     </system>
Dec 06 14:14:42 user nova-compute[75326]:   </sysinfo>
Dec 06 14:14:42 user nova-compute[75326]:   <os>
Dec 06 14:14:42 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:14:42 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:14:42 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:14:42 user nova-compute[75326]:   </os>
Dec 06 14:14:42 user nova-compute[75326]:   <features>
Dec 06 14:14:42 user nova-compute[75326]:     <acpi/>
Dec 06 14:14:42 user nova-compute[75326]:     <apic/>
Dec 06 14:14:42 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:14:42 user nova-compute[75326]:   </features>
Dec 06 14:14:42 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:14:42 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:14:42 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:14:42 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:14:42 user nova-compute[75326]:   </clock>
Dec 06 14:14:42 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:14:42 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:14:42 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:14:42 user nova-compute[75326]:   </cpu>
Dec 06 14:14:42 user nova-compute[75326]:   <devices>
Dec 06 14:14:42 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:14:42 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:14:42 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk"/>
Dec 06 14:14:42 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:14:42 user nova-compute[75326]:     </disk>
Dec 06 14:14:42 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:14:42 user nova-compute[75326]:       <mac address="fa:16:3e:f6:6b:62"/>
Dec 06 14:14:42 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:14:42 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:14:42 user nova-compute[75326]:       <target dev="tapb9cd70bf-7e"/>
Dec 06 14:14:42 user nova-compute[75326]:     </interface>
Dec 06 14:14:42 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:14:42 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/console.log" append="off"/>
Dec 06 14:14:42 user nova-compute[75326]:     </serial>
Dec 06 14:14:42 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:14:42 user nova-compute[75326]:     <video>
Dec 06 14:14:42 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:14:42 user nova-compute[75326]:     </video>
Dec 06 14:14:42 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:14:42 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:14:42 user nova-compute[75326]:     </rng>
Dec 06 14:14:42 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:14:42 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:14:42 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:14:42 user nova-compute[75326]:     </memballoon>
Dec 06 14:14:42 user nova-compute[75326]:   </devices>
Dec 06 14:14:42 user nova-compute[75326]: </domain>
Dec 06 14:14:42 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-c3a23ff4-4d5e-415d-abc8-1c0afb775035. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: 5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-0de16f62-f49a-48a1-bcce-4ba2625f59fb. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port 0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Cannot resize image /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'migration_context' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.objects.base [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Object Instance<7007fec3-20a9-408b-ac10-067919ebab46> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG os_vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78cc2062-af30-5dd0-90ec-4c3d91517523', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9cd70bf-7e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9cd70bf-7e, col_values=(('qos', UUID('bf0b1c0a-74c8-4bd1-9843-7d168f76a302')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9cd70bf-7e, col_values=(('external_ids', {'iface-id': 'b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6b:62', 'vm-uuid': '7007fec3-20a9-408b-ac10-067919ebab46'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:43 user nova-compute[75326]: INFO os_vif [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eae65762-707e-4863-bd22-81e839e5474f req-becb0164-4bd7-416e-a810-8e7cb84fd090 service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Successfully updated port: f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:14:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:14:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-5329d86d-1f81-4df7-a193-ac0dceb4af73. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:14:45 user nova-compute[75326]: WARNING nova.compute.manager [req-d8078b2d-bcba-47b3-8fd9-282647981a48 req-6628299b-d419-41ee-a7c8-86fc661a3a36 service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state powering-on.
Dec 06 14:14:45 user nova-compute[75326]: INFO nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Booting with volume 35f8a256-16ac-4c2a-b234-edb6fd1ffd2e at /dev/vdb
Dec 06 14:14:45 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec202d-f5fa-427f-84de-a5bf34326159]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f70c4e-7218-45fa-8385-58c7e11ae239]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa244eca-28df-4396-a3ab-0504e6a0b925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1d9ec-7c2f-4315-b9db-b83d9094b57b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:46 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2942a0b5-13fb-49dd-83ab-74e23e3061fe]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating existing volume attachment record: 12442e34-fbc0-49ba-bbe0-ec975821757e {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance network_info: |[{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port 5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updated VIF entry in instance network info cache for port 5329d86d-1f81-4df7-a193-ac0dceb4af73. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-f7b98710-b96d-4d30-95b2-92da5a751ebb. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:14:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updated VIF entry in instance network info cache for port f7b98710-b96d-4d30-95b2-92da5a751ebb. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37e5b7b5-e6d4-424d-9e1b-13887fc4a70b req-66257ce8-25c5-4801-b8da-58a80e67d26c service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:14:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance rebooted successfully.
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a5a54b32-58fb-4668-9d21-1e68ec116445 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] No waiting events found dispatching network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:14:47 user nova-compute[75326]: WARNING nova.compute.manager [req-4c09374a-7cd3-403b-96a0-e32655bb3c46 req-7cd38c49-41c2-4ad0-b2ef-d561f307ddff service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received unexpected event network-vif-plugged-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 for instance with vm_state stopped and task_state powering-on.
Dec 06 14:14:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:49 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb35ede4-8060-4d88-9fcf-0affecd71acd is timed out.
Dec 06 14:14:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Successfully detached device vdb from instance bb35ede4-8060-4d88-9fcf-0affecd71acd from the live domain config.
Dec 06 14:14:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWnzlHuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'bde2d497-9cfe-4c08-b28b-b5308d69af02'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:49 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb87eff8-9dff-48ad-a917-539229b8aed2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:14:49 user nova-compute[75326]: No targets found.
Dec 06 14:14:49 user nova-compute[75326]: iSNS:
Dec 06 14:14:49 user nova-compute[75326]: No targets found.
Dec 06 14:14:49 user nova-compute[75326]: STATIC:
Dec 06 14:14:49 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02
Dec 06 14:14:49 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:49 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:49 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:14:49 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:49 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:49 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:14:49 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:14:49 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:14:49 user nova-compute[75326]: FIRMWARE:
Dec 06 14:14:49 user nova-compute[75326]: No targets found.
Dec 06 14:14:49 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:14:49 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:14:49 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd812be9-3ed4-4442-84d2-f2db8d9e41b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f7bed-e636-45f3-992b-30d7cfd11a4f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 (non-flash)
Dec 06 14:14:49 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43823b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b267bc0-c052-4e3b-91e8-b54a93ef25f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0978edc-4bc8-490d-b782-f71d135468a0]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba9a60e-9332-401f-9dab-75462e0c367b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d6a5a7-73ea-4f6e-8a8a-8d804dc0b147]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e01c4a-bf92-4c71-a661-104dce246136]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead2195d-578f-483a-ac2c-ca54c3e39517]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260]
Dec 06 14:14:50 user nova-compute[75326]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02, portal: 172.16.0.220,3260] successful.
Dec 06 14:14:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde2d497-9cfe-4c08-b28b-b5308d69af02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd87474-2e4a-4648-93ab-a1685de7b703]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] <== disconnect_volume: return (370ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:50 user nova-compute[75326]: INFO nova.compute.manager [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Unshelving
Dec 06 14:14:50 user nova-compute[75326]: INFO nova.virt.block_device [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Booting with volume e5086cbb-1e87-4d78-9269-08d5deb9144c at /dev/vdc
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.utils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0badac9-991a-4438-bda5-3d4650174220]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[693687fd-c49e-4f2b-ab67-37b052a70f6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745764b-be75-4eb4-9e9a-4c7396590ed4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5c833-b8ab-421f-beb6-8feae883614a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:50 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:14:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6adf6a-7bf6-47f8-93f3-25409a66cadf]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG os_brick.utils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:50 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating existing volume attachment record: 29cb1e4a-5190-48d6-a0c1-d89674d02eaf {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:14:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lazy-loading 'flavor' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:14:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d01b124-9400-4d78-acad-ead04bd2200d tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.156s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:14:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:14:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:14:55 user nova-compute[75326]: INFO nova.compute.manager [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Detaching volume 087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:14:55 user nova-compute[75326]: INFO nova.virt.block_device [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Attempting to driver detach volume 087f08f1-46b9-4a66-9071-6cba21dbec39 from mountpoint /dev/vdb
Dec 06 14:14:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Attempting to detach device vdb from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:14:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:55 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:55 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:14:55 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:14:55 user nova-compute[75326]:   <serial>087f08f1-46b9-4a66-9071-6cba21dbec39</serial>
Dec 06 14:14:55 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:14:55 user nova-compute[75326]: </disk>
Dec 06 14:14:55 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully detached device vdb from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the persistent domain config.
Dec 06 14:14:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:14:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:14:55 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:14:55 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:14:55 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:14:55 user nova-compute[75326]:   <serial>087f08f1-46b9-4a66-9071-6cba21dbec39</serial>
Dec 06 14:14:55 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:14:55 user nova-compute[75326]: </disk>
Dec 06 14:14:55 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:14:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:14:57 user nova-compute[75326]: INFO nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Booting with volume 9f3b9232-c669-4534-a3dc-0b28ccdae044 at /dev/vdc
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ffd04-76da-4fec-9d67-0eb04a84248d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec96887-faa3-4255-9e75-0d2b0985db06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eab011-927f-4be5-87f1-6e1354d97006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[414bfa7a-d4f9-4905-88a4-a83f2418e2d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:14:57 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:14:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[580dbac0-44ff-4d95-98f5-2b9238b90250]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG os_brick.utils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:14:57 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating existing volume attachment record: a3755864-398d-4cbb-a0d3-8ffbba0cd08a {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:14:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_requests' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'numa_topology' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:15:01 user nova-compute[75326]: INFO nova.compute.claims [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Claim successful on node user
Dec 06 14:15:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:02 user nova-compute[75326]: INFO nova.network.neutron [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating port bafcbd3d-b6ae-4d10-b52c-7546970b3d65 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing instance network info cache due to event network-changed-bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] Acquiring lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:15:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Creating image(s)
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] Acquired lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Refreshing network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG nova.objects.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<125c9956-52f2-465f-98b2-c6a9501f6387> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:04 user nova-compute[75326]: DEBUG nova.virt.images [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] d00ca6bf-95ec-4125-b4da-e35e21ce1d99 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:15:04 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:15:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.part /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.part /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.converted" returned: 0 in 0.445s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updated VIF entry in instance network info cache for port bafcbd3d-b6ae-4d10-b52c-7546970b3d65. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ba6117f-0f5e-4eb5-90c2-80019f48d6fd req-d994f813-ea3d-41b0-9972-95eefaf8c0e6 service nova] Releasing lock "refresh_cache-125c9956-52f2-465f-98b2-c6a9501f6387" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.953s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6,backing_fmt=raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6,backing_fmt=raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk 1073741824" returned: 0 in 0.053s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "e1208bee14e4dd870ef8271110bd0e6be9baecb6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'migration_context' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG nova.objects.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<125c9956-52f2-465f-98b2-c6a9501f6387> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:15:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Rebasing disk image.
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 -F raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:15:08 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Creating image(s)
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Ensure instance console log exists: /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Start _get_guest_xml network_info=[{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '295ba025-e7f4-492a-b545-4f8ed9252cef', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnKQXgPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '380bf541-d329-4557-8951-6b68ba52ae0a', 'attached_at': '', 'detached_at': '', 'volume_id': '044c5aee-640b-4e95-a242-f779ac74a20e', 'serial': '044c5aee-640b-4e95-a242-f779ac74a20e'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '12442e34-fbc0-49ba-bbe0-ec975821757e', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeIqavSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '380bf541-d329-4557-8951-6b68ba52ae0a', 'attached_at': '', 'detached_at': '', 'volume_id': '35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 'serial': '35f8a256-16ac-4c2a-b234-edb6fd1ffd2e'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a3755864-398d-4cbb-a0d3-8ffbba0cd08a', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzqjnMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '380bf541-d329-4557-8951-6b68ba52ae0a', 'attached_at': '', 'detached_at': '', 'volume_id': '9f3b9232-c669-4534-a3dc-0b28ccdae044', 'serial': '9f3b9232-c669-4534-a3dc-0b28ccdae044'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:15:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnKQXgPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:08 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:08 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:08 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260" returned: 21 in 0.084s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3063e2e-4da6-46eb-a5e8-d3714b0ae306]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:15:08 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce355a7-1b5f-423d-96d6-c92369fe8859]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e] added
Dec 06 14:15:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b418e893-77de-4954-8a84-f8953b1d0a5b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[76181561-51ec-402e-8e13-432db8ffd59b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnKQXgPp {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnKQXgPp" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd282828-0e02-4257-8228-524cc4708726]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EnKQXgPp'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a31ed-3943-4113-96cd-135abe3be2ee]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[068579d7-f34b-4901-8853-1e0b864796ed]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:08 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:08 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 -F raw /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk" returned: 0 in 2.505s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Ensure instance console log exists: /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start _get_guest_xml network_info=[{"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ef60e4861758473a27a5a2204d8c6dd1',container_format='bare',created_at=2023-12-06T14:12:57Z,direct_url=<?>,disk_format='qcow2',id=d00ca6bf-95ec-4125-b4da-e35e21ce1d99,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1949009546-shelved',owner='f7c14bbf4b604b6282ec7c5e925c2514',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T14:13:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '29cb1e4a-5190-48d6-a0c1-d89674d02eaf', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVmsFEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '125c9956-52f2-465f-98b2-c6a9501f6387', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5086cbb-1e87-4d78-9269-08d5deb9144c', 'serial': 'e5086cbb-1e87-4d78-9269-08d5deb9144c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:15:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ef60e4861758473a27a5a2204d8c6dd1',container_format='bare',created_at=2023-12-06T14:12:57Z,direct_url=<?>,disk_format='qcow2',id=d00ca6bf-95ec-4125-b4da-e35e21ce1d99,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1949009546-shelved',owner='f7c14bbf4b604b6282ec7c5e925c2514',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T14:13:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88555aa-6163-49f8-94f8-2fd4f99ec243]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260]
Dec 06 14:15:08 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:08 user nova-compute[75326]: DEBUG nova.objects.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<125c9956-52f2-465f-98b2-c6a9501f6387> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVmsFEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:09 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffacc5c-1270-4923-9ca2-ebbf4cb8ce7b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca99f7-d704-4746-9782-94cabbb93009]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:09 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:09 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:09 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:09 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:09 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:09 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b211eea-54e8-4cc5-aa8b-d0003633659a]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnKQXgPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-changed-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Refreshing instance network info cache due to event network-changed-a595c7bf-1a94-4df9-9f5e-b641dbace92c. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] Acquiring lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] Acquired lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.network.neutron [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Refreshing network info cache for port a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23933646436363831', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933646436363831', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.086s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:10 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:10 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badc40b-3c14-4735-a68a-988d52e75faa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:15:10 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeIqavSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:10 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5764a62d-cc2e-4226-8475-d8de3e3278ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c] added
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e418667-66a0-43a0-b7e8-50b8cdf77570]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6184fc0-528a-4bed-853a-21b70a501096]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNVmsFEr {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNVmsFEr" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[615edde2-d4a7-4703-a4a9-45b72b47b10b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNVmsFEr'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bbf16-c5bf-4b97-ae4f-52f2f498e0c8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ba7ae-7767-4594-93a5-418d97eeaf92]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab34a2c-9f5a-409c-b1c7-6c5975a86a31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260]
Dec 06 14:15:10 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[da738c66-0ee3-4279-8d3b-6d00a3658afd]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c17847-7cef-4c71-b464-88a1fde0d802]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:10 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77439b8-d1e0-4be9-9de7-25ebd033ed33]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVmsFEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.network.neutron [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updated VIF entry in instance network info cache for port a595c7bf-1a94-4df9-9f5e-b641dbace92c. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG nova.network.neutron [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating instance_info_cache with network_info: [{"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-46adc3f9-73b8-4cdd-8242-4b9074b54c6c req-47a7294f-e681-469f-a084-3b663936b930 service nova] Releasing lock "refresh_cache-726a915c-ce0b-4759-b96b-a891e2876850" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] <== connect_volume: return (2468ms) {'type': 'block', 'scsi_wwn': '23231393538366264', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393538366264', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.345s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:11 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:11 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e572cf-e62e-4d60-8f98-2b27c82f4382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:15:11 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b35a46c-9f51-4e97-a46a-c7609ffab47d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e] added
Dec 06 14:15:11 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='d00ca6bf-95ec-4125-b4da-e35e21ce1d99',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1968467179',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:13:02.274976',shelved_host='user',shelved_image_id='d00ca6bf-95ec-4125-b4da-e35e21ce1d99'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_devices' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.objects.base [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<125c9956-52f2-465f-98b2-c6a9501f6387> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:15:11 user nova-compute[75326]:   <uuid>125c9956-52f2-465f-98b2-c6a9501f6387</uuid>
Dec 06 14:15:11 user nova-compute[75326]:   <name>instance-0000000f</name>
Dec 06 14:15:11 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:15:11 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:15:11 user nova-compute[75326]:   <metadata>
Dec 06 14:15:11 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:15:11 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1949009546</nova:name>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:15:08</nova:creationTime>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:15:11 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:15:11 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:owner>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:user uuid="921ceb47e4174eb0b5a47fe727d4a1d2">tempest-AttachVolumeShelveTestJSON-82698496-project-member</nova:user>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:project uuid="f7c14bbf4b604b6282ec7c5e925c2514">tempest-AttachVolumeShelveTestJSON-82698496</nova:project>
Dec 06 14:15:11 user nova-compute[75326]:       </nova:owner>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:root type="image" uuid="d00ca6bf-95ec-4125-b4da-e35e21ce1d99"/>
Dec 06 14:15:11 user nova-compute[75326]:       <nova:ports>
Dec 06 14:15:11 user nova-compute[75326]:         <nova:port uuid="bafcbd3d-b6ae-4d10-b52c-7546970b3d65">
Dec 06 14:15:11 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 14:15:11 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:11 user nova-compute[75326]:       </nova:ports>
Dec 06 14:15:11 user nova-compute[75326]:     </nova:instance>
Dec 06 14:15:11 user nova-compute[75326]:   </metadata>
Dec 06 14:15:11 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:15:11 user nova-compute[75326]:     <system>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="serial">125c9956-52f2-465f-98b2-c6a9501f6387</entry>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="uuid">125c9956-52f2-465f-98b2-c6a9501f6387</entry>
Dec 06 14:15:11 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:15:11 user nova-compute[75326]:     </system>
Dec 06 14:15:11 user nova-compute[75326]:   </sysinfo>
Dec 06 14:15:11 user nova-compute[75326]:   <os>
Dec 06 14:15:11 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:15:11 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:15:11 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:15:11 user nova-compute[75326]:   </os>
Dec 06 14:15:11 user nova-compute[75326]:   <features>
Dec 06 14:15:11 user nova-compute[75326]:     <acpi/>
Dec 06 14:15:11 user nova-compute[75326]:     <apic/>
Dec 06 14:15:11 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:15:11 user nova-compute[75326]:   </features>
Dec 06 14:15:11 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:15:11 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:15:11 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:15:11 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:15:11 user nova-compute[75326]:   </clock>
Dec 06 14:15:11 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:15:11 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:15:11 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:15:11 user nova-compute[75326]:   </cpu>
Dec 06 14:15:11 user nova-compute[75326]:   <devices>
Dec 06 14:15:11 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:15:11 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:15:11 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk"/>
Dec 06 14:15:11 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:15:11 user nova-compute[75326]:     </disk>
Dec 06 14:15:11 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:15:11 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:11 user nova-compute[75326]:       <source dev="/dev/sde"/>
Dec 06 14:15:11 user nova-compute[75326]:       <target dev="vdc" bus="virtio"/>
Dec 06 14:15:11 user nova-compute[75326]:       <serial>e5086cbb-1e87-4d78-9269-08d5deb9144c</serial>
Dec 06 14:15:11 user nova-compute[75326]:     </disk>
Dec 06 14:15:11 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:11 user nova-compute[75326]:       <mac address="fa:16:3e:f9:c7:5a"/>
Dec 06 14:15:11 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:11 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:11 user nova-compute[75326]:       <target dev="tapbafcbd3d-b6"/>
Dec 06 14:15:11 user nova-compute[75326]:     </interface>
Dec 06 14:15:11 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:15:11 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/console.log" append="off"/>
Dec 06 14:15:11 user nova-compute[75326]:     </serial>
Dec 06 14:15:11 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:15:11 user nova-compute[75326]:     <video>
Dec 06 14:15:11 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:11 user nova-compute[75326]:     </video>
Dec 06 14:15:11 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:15:11 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:15:11 user nova-compute[75326]:     </rng>
Dec 06 14:15:11 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:15:11 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:15:11 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:15:11 user nova-compute[75326]:     </memballoon>
Dec 06 14:15:11 user nova-compute[75326]:   </devices>
Dec 06 14:15:11 user nova-compute[75326]: </domain>
Dec 06 14:15:11 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='d00ca6bf-95ec-4125-b4da-e35e21ce1d99',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1968467179',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:13:02.274976',shelved_host='user',shelved_image_id='d00ca6bf-95ec-4125-b4da-e35e21ce1d99'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_vif [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef5a91a-1fd4-5f95-bdd6-f0919871ebf7', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256d3ca-b915-4790-9903-83250fad0873]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbafcbd3d-b6, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbafcbd3d-b6, col_values=(('qos', UUID('4a8df86e-c82b-4afe-94c3-7f0e484271ca')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbafcbd3d-b6, col_values=(('external_ids', {'iface-id': 'bafcbd3d-b6ae-4d10-b52c-7546970b3d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:c7:5a', 'vm-uuid': '125c9956-52f2-465f-98b2-c6a9501f6387'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d3c375-1706-4924-87d4-f8254e36b6a7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeIqavSc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:11 user nova-compute[75326]: INFO os_vif [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6')
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeIqavSc" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b0689-203b-4588-9502-4a06585dda96]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NeIqavSc'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb32058-eee7-4668-bc1e-3bb40c133e76]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59368fc-95cd-405c-9611-d20c160b558a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:11 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:11 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:11 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No VIF found with MAC fa:16:3e:f9:c7:5a, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --login" returned: 0 in 1.067s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[693dbb29-b690-4192-b28d-93554933eec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260]
Dec 06 14:15:12 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b6185-1f45-4b9d-8a69-27233bce078a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a1f78-7951-4e46-a6de-85dac9f7b0be]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:12 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.375s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e58f6-478c-4cde-a442-ffb91ff7cfb3]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeIqavSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG nova.objects.instance [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:13 user nova-compute[75326]: INFO nova.compute.manager [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Attaching volume e03231a1-2b30-4f25-aca5-e29bc80e6577 to /dev/vdb
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.utils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[869b2be2-054e-4427-bbfe-b0c38231df5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6213c6ce-2200-421e-844a-f5a5345c5050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4590cae7-0919-464c-bae5-81fb2e3892d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3067535d-6b14-43d7-a2d9-c0340d4b62ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:15:13 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e884ed-20e2-4b5a-9690-76978485598b]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.utils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating existing volume attachment record: 0ad2672e-3141-4cec-a104-587ed6d9783d {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:13 user nova-compute[75326]: WARNING nova.compute.manager [req-a0db2133-0d45-4df4-9c39-61256947b8a9 req-22245b12-3e67-4c0c-b91a-5e9caea29208 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.427s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== connect_volume: return (3772ms) {'type': 'block', 'scsi_wwn': '26433393461383633', 'path': '/dev/sdf'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433393461383633', 'path': '/dev/sdf'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzqjnMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:13 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2dfd27-6538-4a2f-91eb-ef0f58a904ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:15:13 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc4260-46a3-4be0-9245-131f1513e211]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044] added
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51186b65-32c9-434b-8d67-4299c83f02c1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa12fa2-f7e4-4385-b69b-26d38be670fb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzqjnMwf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzqjnMwf" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec15cd57-bc3d-45d8-b6ad-29ee4f630b74]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YzqjnMwf'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f4f650-0e55-4bf0-ae48-e95bed13355e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a62fb4f-890e-4f8a-992f-a73672ae2190]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[675cda52-fe06-4ae5-90bc-77a8daabfd51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260]
Dec 06 14:15:14 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72622b33-6d5e-470d-bea6-02bbd7959626]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f908e7-2526-4c2e-a550-257ba7a3e8ce]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:14 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ef34e-6b2e-466f-8e5a-e0603a16b982]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzqjnMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23638666134626337', 'path': '/dev/sdg'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638666134626337', 'path': '/dev/sdg'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lazy-loading 'pci_devices' on Instance uuid 380bf541-d329-4557-8951-6b68ba52ae0a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:15:15 user nova-compute[75326]:   <uuid>380bf541-d329-4557-8951-6b68ba52ae0a</uuid>
Dec 06 14:15:15 user nova-compute[75326]:   <name>instance-00000015</name>
Dec 06 14:15:15 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:15:15 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:15:15 user nova-compute[75326]:   <metadata>
Dec 06 14:15:15 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:15:15 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:name>tempest-device-tagging-server-963809231</nova:name>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:15:08</nova:creationTime>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:15:15 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:15:15 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:owner>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:user uuid="ad63ce1fea1b43ce92d4261a1a8ec20b">tempest-TaggedBootDevicesTest_v242-288640949-project-member</nova:user>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:project uuid="f09066ffaa044edfbcd83596cb8fdc28">tempest-TaggedBootDevicesTest_v242-288640949</nova:project>
Dec 06 14:15:15 user nova-compute[75326]:       </nova:owner>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:15:15 user nova-compute[75326]:       <nova:ports>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="b2e6387d-91f5-4eb8-9e89-df1eae2757b7">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="c95fcd04-a3c2-4d59-afb9-09e39d4a6056">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="c3a23ff4-4d5e-415d-abc8-1c0afb775035">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="0de16f62-f49a-48a1-bcce-4ba2625f59fb">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="5329d86d-1f81-4df7-a193-ac0dceb4af73">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:         <nova:port uuid="f7b98710-b96d-4d30-95b2-92da5a751ebb">
Dec 06 14:15:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 14:15:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:15:15 user nova-compute[75326]:       </nova:ports>
Dec 06 14:15:15 user nova-compute[75326]:     </nova:instance>
Dec 06 14:15:15 user nova-compute[75326]:   </metadata>
Dec 06 14:15:15 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:15:15 user nova-compute[75326]:     <system>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="serial">380bf541-d329-4557-8951-6b68ba52ae0a</entry>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="uuid">380bf541-d329-4557-8951-6b68ba52ae0a</entry>
Dec 06 14:15:15 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:15:15 user nova-compute[75326]:     </system>
Dec 06 14:15:15 user nova-compute[75326]:   </sysinfo>
Dec 06 14:15:15 user nova-compute[75326]:   <os>
Dec 06 14:15:15 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:15:15 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:15:15 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:15:15 user nova-compute[75326]:   </os>
Dec 06 14:15:15 user nova-compute[75326]:   <features>
Dec 06 14:15:15 user nova-compute[75326]:     <acpi/>
Dec 06 14:15:15 user nova-compute[75326]:     <apic/>
Dec 06 14:15:15 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:15:15 user nova-compute[75326]:   </features>
Dec 06 14:15:15 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:15:15 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:15:15 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:15:15 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:15:15 user nova-compute[75326]:   </clock>
Dec 06 14:15:15 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:15:15 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:15:15 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:15:15 user nova-compute[75326]:   </cpu>
Dec 06 14:15:15 user nova-compute[75326]:   <devices>
Dec 06 14:15:15 user nova-compute[75326]:     <disk type="file" device="cdrom">
Dec 06 14:15:15 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 14:15:15 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/disk.config"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="hda" bus="ide"/>
Dec 06 14:15:15 user nova-compute[75326]:     </disk>
Dec 06 14:15:15 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:15:15 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:15 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <serial>044c5aee-640b-4e95-a242-f779ac74a20e</serial>
Dec 06 14:15:15 user nova-compute[75326]:     </disk>
Dec 06 14:15:15 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:15:15 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:15 user nova-compute[75326]:       <source dev="/dev/sdf"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <serial>35f8a256-16ac-4c2a-b234-edb6fd1ffd2e</serial>
Dec 06 14:15:15 user nova-compute[75326]:     </disk>
Dec 06 14:15:15 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:15:15 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:15 user nova-compute[75326]:       <source dev="/dev/sdg"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="vdc" bus="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <serial>9f3b9232-c669-4534-a3dc-0b28ccdae044</serial>
Dec 06 14:15:15 user nova-compute[75326]:     </disk>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:7e:fe:90"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tapb2e6387d-91"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:3e:ec:16"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tap44fc6e77-bc"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:48:f6:08"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tapc95fcd04-a3"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:30:c3:c2"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tapc3a23ff4-4d"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:1f:00:b8"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tap0de16f62-f4"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:1a:bf:0d"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tap5329d86d-1f"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:15:15 user nova-compute[75326]:       <mac address="fa:16:3e:4e:4e:06"/>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:15:15 user nova-compute[75326]:       <target dev="tapf7b98710-b9"/>
Dec 06 14:15:15 user nova-compute[75326]:     </interface>
Dec 06 14:15:15 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:15:15 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/console.log" append="off"/>
Dec 06 14:15:15 user nova-compute[75326]:     </serial>
Dec 06 14:15:15 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:15:15 user nova-compute[75326]:     <video>
Dec 06 14:15:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:15:15 user nova-compute[75326]:     </video>
Dec 06 14:15:15 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:15:15 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:15:15 user nova-compute[75326]:     </rng>
Dec 06 14:15:15 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:15:15 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:15:15 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:15:15 user nova-compute[75326]:     </memballoon>
Dec 06 14:15:15 user nova-compute[75326]:   </devices>
Dec 06 14:15:15 user nova-compute[75326]: </domain>
Dec 06 14:15:15 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c46328dc-d6d9-5dbb-b73a-ac7cf8cb8ea5', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2e6387d-91, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2e6387d-91, col_values=(('qos', UUID('cdb036ae-af85-4716-983b-9e73bc97ad46')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2e6387d-91, col_values=(('external_ids', {'iface-id': 'b2e6387d-91f5-4eb8-9e89-df1eae2757b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:fe:90', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7435c23-e247-59b8-8b63-8fc0e78a113d', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44fc6e77-bc, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44fc6e77-bc, col_values=(('qos', UUID('e7cb91c0-efa4-4ce9-b607-4388ee07f6d0')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44fc6e77-bc, col_values=(('external_ids', {'iface-id': '44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:ec:16', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4b4be3f-8e61-5ad0-b35f-d3851b1aa1fe', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc95fcd04-a3, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc95fcd04-a3, col_values=(('qos', UUID('bf280d2b-c7c7-409b-b071-8e6a991a73ee')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc95fcd04-a3, col_values=(('external_ids', {'iface-id': 'c95fcd04-a3c2-4d59-afb9-09e39d4a6056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:f6:08', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '893632c2-bef1-53f5-afb0-fb9486391c73', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:15 user nova-compute[75326]: WARNING nova.compute.manager [req-ebe7027f-a5a2-4dd9-b31a-cc4fcdd5e5bd req-b94a0464-fe25-452e-ba96-6a74ffd0790f service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a23ff4-4d, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a23ff4-4d, col_values=(('qos', UUID('1b3b91cb-34dd-4f24-b699-8fbcc2cbf86d')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a23ff4-4d, col_values=(('external_ids', {'iface-id': 'c3a23ff4-4d5e-415d-abc8-1c0afb775035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c3:c2', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance spawned successfully.
Dec 06 14:15:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 is timed out.
Dec 06 14:15:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully detached device vdb from instance 878463cf-3b96-45ab-a0c7-016de78c16c9 from the live domain config.
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNpQZxWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:15 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39bf95cf-ce76-504e-a579-cf9fc8a944ea', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[861b2077-3326-4abf-865f-a2417b20151c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:15:15 user nova-compute[75326]: No targets found.
Dec 06 14:15:15 user nova-compute[75326]: iSNS:
Dec 06 14:15:15 user nova-compute[75326]: No targets found.
Dec 06 14:15:15 user nova-compute[75326]: STATIC:
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e
Dec 06 14:15:15 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:15 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:15 user nova-compute[75326]: FIRMWARE:
Dec 06 14:15:15 user nova-compute[75326]: No targets found.
Dec 06 14:15:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:15:15 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:15:15 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf56b9ec-170c-4ba0-9afd-113802253c9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0de16f62-f4, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0de16f62-f4, col_values=(('qos', UUID('5b8b0122-9aea-4f97-b90d-940afe38d743')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0de16f62-f4, col_values=(('external_ids', {'iface-id': '0de16f62-f49a-48a1-bcce-4ba2625f59fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:00:b8', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f625f72-36e3-4c47-8835-859c5352d181]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:15 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd407c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1fce9-25ff-405b-be6b-758463822efe]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1164a36-3141-5458-8177-44fd33680fc5', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1bfe4-d275-4325-9479-e8a327e1edfa]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a4bf2-efaf-4fef-8a8b-5d674baeb5a2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5329d86d-1f, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5329d86d-1f, col_values=(('qos', UUID('d7c0204e-8041-43ac-9228-dd79dd9516e3')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5329d86d-1f, col_values=(('external_ids', {'iface-id': '5329d86d-1f81-4df7-a193-ac0dceb4af73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:bf:0d', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b3215-d583-4e15-bd49-7c1a9dfde688]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4690980-4926-4347-9fed-bf5773d425e2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f')
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df90a59d-5342-5e47-8b87-51ab6927a5be', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8f276-0b19-4ad8-be16-6b47e0d975d9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260]
Dec 06 14:15:16 user nova-compute[75326]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7b98710-b9, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7b98710-b9, col_values=(('qos', UUID('81b90772-f4bf-41c0-beab-926c58f1c8ac')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7b98710-b9, col_values=(('external_ids', {'iface-id': 'f7b98710-b96d-4d30-95b2-92da5a751ebb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:4e:06', 'vm-uuid': '380bf541-d329-4557-8951-6b68ba52ae0a'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087f08f1-46b9-4a66-9071-6cba21dbec39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a7b9a-ed57-420c-8ab9-2e44e8776d32]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] <== disconnect_volume: return (377ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:16 user nova-compute[75326]: INFO os_vif [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9')
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ce5d0f4-1bb3-4687-a4c4-a09c69bc8e55 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.815s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] No BDM found with device name hda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] No VIF found with MAC fa:16:3e:7e:fe:90, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] No VIF found with MAC fa:16:3e:1f:00:b8, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:15:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Using config drive
Dec 06 14:15:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Creating config drive at /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/disk.config
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw5ojb371 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw5ojb371" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'flavor' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-02e7a13b-ae5e-4b06-8517-410c1fa8cda6 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:18 user nova-compute[75326]: WARNING nova.compute.manager [req-07015b5b-012b-4d8d-85ba-3e7655a15126 req-0a5953e1-f635-4abc-8b87-03978fbd5806 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 for instance with vm_state building and task_state spawning.
Dec 06 14:15:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:19 user nova-compute[75326]: WARNING nova.compute.manager [req-4f4b05f5-1cf0-4e42-aa41-0568a158b5f6 req-12171aa5-dce2-473f-ae6b-c03446c22e94 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 for instance with vm_state building and task_state spawning.
Dec 06 14:15:19 user nova-compute[75326]: INFO nova.compute.manager [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Terminating instance
Dec 06 14:15:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:20 user nova-compute[75326]: WARNING nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 for instance with vm_state building and task_state spawning.
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:20 user nova-compute[75326]: WARNING nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 for instance with vm_state building and task_state spawning.
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:20 user nova-compute[75326]: WARNING nova.compute.manager [req-2bffba94-23cd-400c-a91b-268331f4ff28 req-b4a1a7b4-e4ea-4386-8849-50047ae328d4 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 for instance with vm_state building and task_state spawning.
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:20 user nova-compute[75326]: WARNING nova.compute.manager [req-cb66ea9a-dee8-4f52-9ea5-39bfbe3b5594 req-a6335429-c28a-4089-8544-030504e4663f service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 for instance with vm_state building and task_state spawning.
Dec 06 14:15:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Instance destroyed successfully.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lazy-loading 'resources' on Instance uuid bb35ede4-8060-4d88-9fcf-0affecd71acd {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1893561618',display_name='tempest-TestVolumeSwap-server-1893561618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1893561618',id=17,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTHhqa7Wfj/iKDoIfSIoEVCrogI4RJ9HNnfopd6SGd3+iuKleAyOpJKf3rzTkk5LuGIJPkW2gZFzLJqUbj4FUGEcZzGRAMozmEbruLcOXGZGp/PW6vFfOnJXOWK/N8qiw==',key_name='tempest-keypair-299244476',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd60ee5320d4e1eb42c2556e0a993bd',ramdisk_id='',reservation_id='r-zz5t0u44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1183255736',owner_user_name='tempest-TestVolumeSwap-1183255736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de94506da0934b2cbbba2c435cc8457b',uuid=bb35ede4-8060-4d88-9fcf-0affecd71acd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converting VIF {"id": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "address": "fa:16:3e:20:a8:0b", "network": {"id": "b18a9bad-0559-49a7-a76d-bb934f4d44d2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1730196335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd60ee5320d4e1eb42c2556e0a993bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbdcd98-aa", "ovs_interfaceid": "ddbdcd98-aa19-4ed6-98ab-2a348f32b5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG os_vif [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddbdcd98-aa, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4db1dd5-ed79-4a8a-a2b6-6bd6662ed955) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: INFO os_vif [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:a8:0b,bridge_name='br-int',has_traffic_filtering=True,id=ddbdcd98-aa19-4ed6-98ab-2a348f32b5df,network=Network(b18a9bad-0559-49a7-a76d-bb934f4d44d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbdcd98-aa')
Dec 06 14:15:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Deleting instance files /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd_del
Dec 06 14:15:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Deletion of /opt/stack/data/nova/instances/bb35ede4-8060-4d88-9fcf-0affecd71acd_del complete
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:21 user nova-compute[75326]: INFO nova.compute.manager [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Took 1.77 seconds to destroy the instance on the hypervisor.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 for instance with vm_state building and task_state spawning.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 for instance with vm_state building and task_state spawning.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 for instance with vm_state building and task_state spawning.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-unplugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] No waiting events found dispatching network-vif-unplugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-unplugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] No waiting events found dispatching network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received unexpected event network-vif-plugged-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df for instance with vm_state active and task_state deleting.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb for instance with vm_state building and task_state spawning.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:21 user nova-compute[75326]: WARNING nova.compute.manager [req-bc6abce6-70d8-498a-ac2b-adb39bab1f1c req-c9802d39-92c9-4926-9298-8e1d994305b8 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb for instance with vm_state building and task_state spawning.
Dec 06 14:15:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:22 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Took 1.14 seconds to deallocate network for instance.
Dec 06 14:15:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:23 user nova-compute[75326]: WARNING nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 for instance with vm_state building and task_state spawning.
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:23 user nova-compute[75326]: WARNING nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb for instance with vm_state building and task_state spawning.
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:23 user nova-compute[75326]: WARNING nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb for instance with vm_state building and task_state spawning.
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b59622c0-a750-4b0a-9502-63e205eca4fc req-f04ac648-3aa0-4b83-8f04-7b6c00956aca service nova] [instance: bb35ede4-8060-4d88-9fcf-0affecd71acd] Received event network-vif-deleted-ddbdcd98-aa19-4ed6-98ab-2a348f32b5df {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:23 user nova-compute[75326]: INFO nova.compute.manager [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Terminating instance
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Deleted allocations for instance bb35ede4-8060-4d88-9fcf-0affecd71acd
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44e46ee1-abd6-4005-a694-e6fa5b6ce72c tempest-TestVolumeSwap-1183255736 tempest-TestVolumeSwap-1183255736-project-member] Lock "bb35ede4-8060-4d88-9fcf-0affecd71acd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.812s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-unplugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] No waiting events found dispatching network-vif-unplugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-unplugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Acquiring lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] No waiting events found dispatching network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:23 user nova-compute[75326]: WARNING nova.compute.manager [req-2c004a97-188f-4881-b521-0b0fbca28b4f req-47363375-ff0a-41a1-a1e7-1809b4f0ba96 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received unexpected event network-vif-plugged-1905025a-e9e6-47d2-b5bc-de95230f1f50 for instance with vm_state active and task_state deleting.
Dec 06 14:15:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Instance destroyed successfully.
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lazy-loading 'resources' on Instance uuid 8b318cff-3431-45bf-8712-ea2d1cd59e3a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1411425675',display_name='tempest-ServersNegativeTestJSON-server-1411425675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1411425675',id=1,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a69d2306b2849a4b43c0c7a405b8ffb',ramdisk_id='',reservation_id='r-x0lj67z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-569900546',owner_user_name='tempest-ServersNegativeTestJSON-569900546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:06:53Z,user_data=None,user_id='ce486cacce1b41b8b77d6c61df954d6b',uuid=8b318cff-3431-45bf-8712-ea2d1cd59e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converting VIF {"id": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "address": "fa:16:3e:b6:f8:a6", "network": {"id": "8046d1ca-f52a-4d06-8837-2c292b187747", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-820710893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a69d2306b2849a4b43c0c7a405b8ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1905025a-e9", "ovs_interfaceid": "1905025a-e9e6-47d2-b5bc-de95230f1f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG os_vif [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1905025a-e9, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61778ddd-2eff-40d6-96b6-bb7924a664a4) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:24 user nova-compute[75326]: INFO os_vif [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:f8:a6,bridge_name='br-int',has_traffic_filtering=True,id=1905025a-e9e6-47d2-b5bc-de95230f1f50,network=Network(8046d1ca-f52a-4d06-8837-2c292b187747),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1905025a-e9')
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Deleting instance files /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a_del
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Deletion of /opt/stack/data/nova/instances/8b318cff-3431-45bf-8712-ea2d1cd59e3a_del complete
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance spawned successfully.
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.compute.manager [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 14:15:24 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Took 15.68 seconds to spawn the instance on the hypervisor.
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.compute.manager [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Took 49.94 seconds to build instance.
Dec 06 14:15:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d26816bf-8da3-481f-aaf7-b656e6d6b45d tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.060s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:24 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Took 0.73 seconds to deallocate network for instance.
Dec 06 14:15:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-2624ad6a-9ef1-4f6e-9400-f9f3ff8be007 req-90b9fb33-17d6-49f8-bb91-17e14d1f3e80 service nova] [instance: 8b318cff-3431-45bf-8712-ea2d1cd59e3a] Received event network-vif-deleted-1905025a-e9e6-47d2-b5bc-de95230f1f50 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:25 user nova-compute[75326]: INFO nova.compute.manager [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Terminating instance
Dec 06 14:15:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:25 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Deleted allocations for instance 8b318cff-3431-45bf-8712-ea2d1cd59e3a
Dec 06 14:15:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ff8463d1-c0c8-4955-bbee-17c3756b2f20 tempest-ServersNegativeTestJSON-569900546 tempest-ServersNegativeTestJSON-569900546-project-member] Lock "8b318cff-3431-45bf-8712-ea2d1cd59e3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.552s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Instance destroyed successfully.
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lazy-loading 'resources' on Instance uuid 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-975828569',display_name='tempest-ServerActionsTestOtherB-server-975828569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-975828569',id=5,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcR8VohG6R5DutmtiedulWsoRe9i1+vmGfLNqgbWDVptQ+6qro+zSoACtb15PTrAt/GJu4Ro3rzckoBBcQts7s8E8Q4bl7JKabuCMDcNtWIBg9vWSEM3y0w2pCFNh985g==',key_name='tempest-keypair-677890497',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='520e0b71d75a4c5cab40749ad8f40539',ramdisk_id='',reservation_id='r-gkxp7iuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1534306586',owner_user_name='tempest-ServerActionsTestOtherB-1534306586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accd4da2df4141ff9e19420b42a22056',uuid=7c41dda6-b0b1-44e3-8696-e085ff4f2bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converting VIF {"id": "765ea7bc-2156-4815-bede-834d676d7edd", "address": "fa:16:3e:d4:cf:df", "network": {"id": "1b6919ca-69aa-48b1-b401-074244deaf0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-557034340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "520e0b71d75a4c5cab40749ad8f40539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765ea7bc-21", "ovs_interfaceid": "765ea7bc-2156-4815-bede-834d676d7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_vif [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap765ea7bc-21, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dd4285e-6a94-4936-b8d0-9e92c14ec819) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:26 user nova-compute[75326]: INFO os_vif [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=765ea7bc-2156-4815-bede-834d676d7edd,network=Network(1b6919ca-69aa-48b1-b401-074244deaf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765ea7bc-21')
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLbXQwJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf987332-23ba-45c7-adf7-2f2693f41df7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:15:26 user nova-compute[75326]: No targets found.
Dec 06 14:15:26 user nova-compute[75326]: iSNS:
Dec 06 14:15:26 user nova-compute[75326]: No targets found.
Dec 06 14:15:26 user nova-compute[75326]: STATIC:
Dec 06 14:15:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:15:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9
Dec 06 14:15:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:15:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c
Dec 06 14:15:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e
Dec 06 14:15:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:26 user nova-compute[75326]: FIRMWARE:
Dec 06 14:15:26 user nova-compute[75326]: No targets found.
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:15:26 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:15:26 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMFbuQsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a2ebc-b20e-4007-9d4b-98b6a1eb1333]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[564315ba-0875-4fbb-84bb-fd5cd4bf88ef]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8be0d9-8cf0-4d39-9ad3-8532f6e21014]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce12e51-bcf1-4ac0-956a-612fbb5b25d4]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8799e1-e67c-4b9f-85ad-9c587fcd849e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d30fe-cdee-41fe-a982-02a18c560583]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf30cdf-dd15-475d-a1fd-d424d493e511]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e3626-1c51-4c34-9d91-01dbed1835d2]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260]
Dec 06 14:15:26 user nova-compute[75326]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebf9723-a57b-4a0a-b6bb-e1968eda36e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4355aa1-89e6-4f2b-84fd-37a67339b85d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] <== disconnect_volume: return (355ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:15:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Deleting instance files /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_del
Dec 06 14:15:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Deletion of /opt/stack/data/nova/instances/7c41dda6-b0b1-44e3-8696-e085ff4f2bbf_del complete
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.332s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:26 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a09154-2289-4b83-b68b-1dc64f0d519d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:15:26 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3605a6a5-ebfd-4f02-913f-8a60ff324456]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577] added
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87bd3f9-469c-4c7c-bf03-966161d236fc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0623fb-5d09-45ce-be03-e8a3a688890c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMFbuQsI {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: INFO nova.compute.manager [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Took 1.42 seconds to destroy the instance on the hypervisor.
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMFbuQsI" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dad07a-ba41-4478-ae3b-90e33a3b3327]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AMFbuQsI'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf53a2-5097-4ff8-8b6a-b2d4fc152186]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3cc0fd-c484-43d7-8fa5-cecc21ae2846]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1571e19-1877-42b7-bf68-6fd784f877b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260]
Dec 06 14:15:26 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63dea4d-2d84-4299-b6a5-84e4e7413d29]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f038f60-3606-4edf-bec3-f69bf1806c24]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)
Dec 06 14:15:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc025f-8c9a-42de-b16b-fd0ec356a893]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:15:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMFbuQsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-unplugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Acquiring lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] No waiting events found dispatching network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:27 user nova-compute[75326]: WARNING nova.compute.manager [req-23b04641-a495-4420-a820-91f1d0931a24 req-38c4d0bc-4803-4a60-af57-b13677a95bd9 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received unexpected event network-vif-plugged-765ea7bc-2156-4815-bede-834d676d7edd for instance with vm_state active and task_state deleting.
Dec 06 14:15:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:27 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Took 0.88 seconds to deallocate network for instance.
Dec 06 14:15:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== connect_volume: return (1750ms) {'type': 'block', 'scsi_wwn': '23266653038616430', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266653038616430', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:15:27 user nova-compute[75326]: DEBUG nova.objects.instance [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:15:28 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:28 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:15:28 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:15:28 user nova-compute[75326]:   <serial>e03231a1-2b30-4f25-aca5-e29bc80e6577</serial>
Dec 06 14:15:28 user nova-compute[75326]: </disk>
Dec 06 14:15:28 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:c0:dd:32, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:15:28 user nova-compute[75326]: INFO nova.compute.manager [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Took 1.08 seconds to detach 1 volumes for instance.
Dec 06 14:15:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bac90406-57e2-4337-ae07-2616ee3e7e3a tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.534s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:29 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Deleted allocations for instance 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3f621a5e-6956-4540-b92f-1a8e5d7f4fbc tempest-ServerActionsTestOtherB-1534306586 tempest-ServerActionsTestOtherB-1534306586-project-member] Lock "7c41dda6-b0b1-44e3-8696-e085ff4f2bbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.921s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-0faa9bd3-6dcd-4df8-8926-f3dadd53b6bd req-7a893eea-d058-49f5-87c6-a2a797041783 service nova] [instance: 7c41dda6-b0b1-44e3-8696-e085ff4f2bbf] Received event network-vif-deleted-765ea7bc-2156-4815-bede-834d676d7edd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:30 user nova-compute[75326]: INFO nova.compute.manager [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Detaching volume e03231a1-2b30-4f25-aca5-e29bc80e6577
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:30 user nova-compute[75326]: INFO nova.virt.block_device [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Attempting to driver detach volume e03231a1-2b30-4f25-aca5-e29bc80e6577 from mountpoint /dev/vdb
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Attempting to detach device vdb from instance 726a915c-ce0b-4759-b96b-a891e2876850 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:15:30 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:30 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:15:30 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:15:30 user nova-compute[75326]:   <serial>e03231a1-2b30-4f25-aca5-e29bc80e6577</serial>
Dec 06 14:15:30 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:15:30 user nova-compute[75326]: </disk>
Dec 06 14:15:30 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:15:30 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance 726a915c-ce0b-4759-b96b-a891e2876850 from the persistent domain config.
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 726a915c-ce0b-4759-b96b-a891e2876850 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:15:30 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:15:30 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:15:30 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:15:30 user nova-compute[75326]:   <serial>e03231a1-2b30-4f25-aca5-e29bc80e6577</serial>
Dec 06 14:15:30 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:15:30 user nova-compute[75326]: </disk>
Dec 06 14:15:30 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7987MB free_disk=25.57568359375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 878463cf-3b96-45ab-a0c7-016de78c16c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 726a915c-ce0b-4759-b96b-a891e2876850 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 380bf541-d329-4557-8951-6b68ba52ae0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 125c9956-52f2-465f-98b2-c6a9501f6387 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:15:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:15:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [{"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-7007fec3-20a9-408b-ac10-067919ebab46" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:15:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:15:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:45 user nova-compute[75326]: INFO nova.compute.manager [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Terminating instance
Dec 06 14:15:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-unplugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] No waiting events found dispatching network-vif-unplugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-b88fc9bb-8bdd-4516-a501-5d168e364e72 req-b7c76c59-e26a-4e23-a322-9152baa4f4f6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-unplugged-4ed35278-449c-4899-8047-1943cf41e4ea for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:15:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Instance destroyed successfully.
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.objects.instance [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lazy-loading 'resources' on Instance uuid 878463cf-3b96-45ab-a0c7-016de78c16c9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-109173860',display_name='tempest-TestServerVolumeAttachmentScenario-server-109173860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-109173860',id=16,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWyPoyiYKfUP9rwYn4k3ktpaQG2xH/cbOiiQk+1fQvuMa6YZSoKEx8bmWLzI1g/WYGRrsEFZydEHUoJA9pbXYQliCh9wG4skCMyokOtzipRyLrVG0TKazZB/ZQgB5ZRcQ==',key_name='tempest-keypair-1675909277',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1319f4f24f1142278a5287e830e6d88c',ramdisk_id='',reservation_id='r-cyyju3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-286508729',owner_user_name='tempest-TestServerVolumeAttachmentScenario-286508729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e1450369534ddf885110ad05b10ede',uuid=878463cf-3b96-45ab-a0c7-016de78c16c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converting VIF {"id": "4ed35278-449c-4899-8047-1943cf41e4ea", "address": "fa:16:3e:2e:98:af", "network": {"id": "071809a9-591a-4370-b0a1-5b083092bd28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-600885435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1319f4f24f1142278a5287e830e6d88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed35278-44", "ovs_interfaceid": "4ed35278-449c-4899-8047-1943cf41e4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG os_vif [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed35278-44, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7cf0dc1-b261-4eb6-bfb8-e664cbf5035f) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:46 user nova-compute[75326]: INFO os_vif [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:98:af,bridge_name='br-int',has_traffic_filtering=True,id=4ed35278-449c-4899-8047-1943cf41e4ea,network=Network(071809a9-591a-4370-b0a1-5b083092bd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed35278-44')
Dec 06 14:15:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Deleting instance files /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9_del
Dec 06 14:15:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Deletion of /opt/stack/data/nova/instances/878463cf-3b96-45ab-a0c7-016de78c16c9_del complete
Dec 06 14:15:46 user nova-compute[75326]: INFO nova.compute.manager [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 14:15:46 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:15:46 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:47 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Took 0.81 seconds to deallocate network for instance.
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-0df15445-7ea1-4a19-b388-d2fdfe729eb1 req-812c5ed4-920f-45b7-8740-777222257340 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-deleted-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:47 user nova-compute[75326]: INFO nova.compute.manager [req-0df15445-7ea1-4a19-b388-d2fdfe729eb1 req-812c5ed4-920f-45b7-8740-777222257340 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Neutron deleted interface 4ed35278-449c-4899-8047-1943cf41e4ea; detaching it from the instance and deleting it from the info cache
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-0df15445-7ea1-4a19-b388-d2fdfe729eb1 req-812c5ed4-920f-45b7-8740-777222257340 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-0df15445-7ea1-4a19-b388-d2fdfe729eb1 req-812c5ed4-920f-45b7-8740-777222257340 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Detach interface failed, port_id=4ed35278-449c-4899-8047-1943cf41e4ea, reason: Instance 878463cf-3b96-45ab-a0c7-016de78c16c9 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:47 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Deleted allocations for instance 878463cf-3b96-45ab-a0c7-016de78c16c9
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa63305d-f0bd-4731-b6e3-8dcda4899c86 tempest-TestServerVolumeAttachmentScenario-286508729 tempest-TestServerVolumeAttachmentScenario-286508729-project-member] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.206s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] Acquiring lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] Lock "878463cf-3b96-45ab-a0c7-016de78c16c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] No waiting events found dispatching network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:15:47 user nova-compute[75326]: WARNING nova.compute.manager [req-f199906f-5c71-43f5-8a33-748430b6e172 req-e9dc7bdf-5fea-4556-9199-a1c872a2dfd6 service nova] [instance: 878463cf-3b96-45ab-a0c7-016de78c16c9] Received unexpected event network-vif-plugged-4ed35278-449c-4899-8047-1943cf41e4ea for instance with vm_state deleted and task_state None.
Dec 06 14:15:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 726a915c-ce0b-4759-b96b-a891e2876850 is timed out.
Dec 06 14:15:50 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance 726a915c-ce0b-4759-b96b-a891e2876850 from the live domain config.
Dec 06 14:15:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMFbuQsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:15:50 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a73efb-fc77-4bee-90fb-46bb96ca2fda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:15:50 user nova-compute[75326]: No targets found.
Dec 06 14:15:50 user nova-compute[75326]: iSNS:
Dec 06 14:15:50 user nova-compute[75326]: No targets found.
Dec 06 14:15:50 user nova-compute[75326]: STATIC:
Dec 06 14:15:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577
Dec 06 14:15:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:15:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:15:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c
Dec 06 14:15:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e
Dec 06 14:15:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:15:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:15:50 user nova-compute[75326]: FIRMWARE:
Dec 06 14:15:50 user nova-compute[75326]: No targets found.
Dec 06 14:15:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:15:50 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:15:50 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb55f9-7e12-4848-932a-e41b5a75b7dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ef177-c504-4424-8aa5-a7ff3c12d9f1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)
Dec 06 14:15:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:15:50 user nova-compute[75326]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 (non-flash)
Dec 06 14:15:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40fb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40958f0-1ecd-41dc-8d8a-3e83a8037535]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f7013f-dcbc-4516-84f2-91824e858680]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51531de1-a6d3-43b3-93f5-6b35b2d1851a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8e4f8-f158-4516-a899-8122b6adcad8]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c7b52b-4d00-4b63-8acd-24b30db90a4a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe49c08-dd8c-4afe-8e6c-029e31513434]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260]
Dec 06 14:15:51 user nova-compute[75326]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577, portal: 172.16.0.220,3260] successful.
Dec 06 14:15:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03231a1-2b30-4f25-aca5-e29bc80e6577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf50d72-93cb-4e6c-9e9e-d45bc6b00902]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== disconnect_volume: return (316ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:15:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-991e98b1-386a-4b84-856b-5b51c6f7d06f tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:15:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:15:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:20 user nova-compute[75326]: INFO nova.compute.manager [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Terminating instance
Dec 06 14:16:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-unplugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] No waiting events found dispatching network-vif-unplugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-6ad0a747-16f9-4453-b6f5-43a961299f18 req-2d2c6c0a-d443-4590-ab1c-91b381ded668 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-unplugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Instance destroyed successfully.
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'resources' on Instance uuid 726a915c-ce0b-4759-b96b-a891e2876850 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911666535',display_name='tempest-AttachVolumeNegativeTest-server-1911666535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911666535',id=20,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC83jiu5VXDvLAvG4VTRMWZnq6S/MBw/SwBCDXItHw2iSSx7k6AoN0X3JZV4Eb4wtIGGs+YD0Z0RiQIpWA5vYUNabzP4uk6Ewt95AcqnP/nSCSkzoh1anLs+vrWBRwdlQA==',key_name='tempest-keypair-134796028',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:13:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-2sxv3qp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=726a915c-ce0b-4759-b96b-a891e2876850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "address": "fa:16:3e:c0:dd:32", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa595c7bf-1a", "ovs_interfaceid": "a595c7bf-1a94-4df9-9f5e-b641dbace92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG os_vif [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa595c7bf-1a, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7457b38b-d2ec-4df4-b8e5-c2b02e3f8b03) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:21 user nova-compute[75326]: INFO os_vif [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:dd:32,bridge_name='br-int',has_traffic_filtering=True,id=a595c7bf-1a94-4df9-9f5e-b641dbace92c,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa595c7bf-1a')
Dec 06 14:16:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Deleting instance files /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850_del
Dec 06 14:16:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Deletion of /opt/stack/data/nova/instances/726a915c-ce0b-4759-b96b-a891e2876850_del complete
Dec 06 14:16:21 user nova-compute[75326]: INFO nova.compute.manager [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 06 14:16:21 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:16:21 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-935b3a1d-1506-4112-a3bc-b07c133bde60 req-68fd1d3f-035c-4798-9cd1-2f5e858ec7be service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-deleted-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:22 user nova-compute[75326]: INFO nova.compute.manager [req-935b3a1d-1506-4112-a3bc-b07c133bde60 req-68fd1d3f-035c-4798-9cd1-2f5e858ec7be service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Neutron deleted interface a595c7bf-1a94-4df9-9f5e-b641dbace92c; detaching it from the instance and deleting it from the info cache
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.network.neutron [req-935b3a1d-1506-4112-a3bc-b07c133bde60 req-68fd1d3f-035c-4798-9cd1-2f5e858ec7be service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:22 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Took 0.77 seconds to deallocate network for instance.
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-935b3a1d-1506-4112-a3bc-b07c133bde60 req-68fd1d3f-035c-4798-9cd1-2f5e858ec7be service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Detach interface failed, port_id=a595c7bf-1a94-4df9-9f5e-b641dbace92c, reason: Instance 726a915c-ce0b-4759-b96b-a891e2876850 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:22 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Deleted allocations for instance 726a915c-ce0b-4759-b96b-a891e2876850
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-84b4030c-ca5d-481e-aa06-bfb9318b6494 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "726a915c-ce0b-4759-b96b-a891e2876850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] Acquiring lock "726a915c-ce0b-4759-b96b-a891e2876850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] Lock "726a915c-ce0b-4759-b96b-a891e2876850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] No waiting events found dispatching network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:22 user nova-compute[75326]: WARNING nova.compute.manager [req-987a3d57-cab1-4063-9237-4b708170fd02 req-1866bf30-ebc1-465e-919a-25bbd62321d7 service nova] [instance: 726a915c-ce0b-4759-b96b-a891e2876850] Received unexpected event network-vif-plugged-a595c7bf-1a94-4df9-9f5e-b641dbace92c for instance with vm_state deleted and task_state None.
Dec 06 14:16:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:32 user nova-compute[75326]: INFO nova.compute.manager [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Rescuing
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "7007fec3-20a9-408b-ac10-067919ebab46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:33 user nova-compute[75326]: INFO nova.compute.manager [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Terminating instance
Dec 06 14:16:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:34 user nova-compute[75326]: WARNING nova.compute.manager [req-e88b5e74-507e-4369-8ce2-426a5f6c8876 req-9bbacecd-8bde-4aee-9c7a-38ee2a812150 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state active and task_state rescuing.
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Instance destroyed successfully.
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'resources' on Instance uuid 7007fec3-20a9-408b-ac10-067919ebab46 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8261MB free_disk=25.620113372802734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance destroyed successfully.
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1364634591',display_name='tempest-AttachVolumeTestJSON-server-1364634591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1364634591',id=3,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2ptorwjCJmnjMtMEmEKStez2tgA1maX30cMsybYsjMojfYr+9JAeXMDsOE2QKURLwCpfZRuaPLvqa0LUW0LiNjotndYl6YJ51sO0p2Ib0WItgCsdbkLHUwIIFIf6CGDg==',key_name='tempest-keypair-926823015',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-opp5v9hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=7007fec3-20a9-408b-ac10-067919ebab46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "address": "fa:16:3e:f6:6b:62", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd70bf-7e", "ovs_interfaceid": "b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG os_vif [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9cd70bf-7e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Attempting rescue
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf0b1c0a-74c8-4bd1-9843-7d168f76a302) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Creating image(s)
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:34 user nova-compute[75326]: INFO os_vif [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:62,bridge_name='br-int',has_traffic_filtering=True,id=b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd70bf-7e')
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Deleting instance files /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46_del
Dec 06 14:16:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Deletion of /opt/stack/data/nova/instances/7007fec3-20a9-408b-ac10-067919ebab46_del complete
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:35 user nova-compute[75326]: INFO nova.compute.manager [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Took 1.77 seconds to destroy the instance on the hypervisor.
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7007fec3-20a9-408b-ac10-067919ebab46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 380bf541-d329-4557-8951-6b68ba52ae0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 125c9956-52f2-465f-98b2-c6a9501f6387 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue" returned: 0 in 0.065s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'migration_context' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.base [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<a1572caf-4d57-4c7c-9250-636f19bfb73a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start _get_guest_xml network_info=[{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:97:3a:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.base [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<a1572caf-4d57-4c7c-9250-636f19bfb73a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'numa_topology' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.base [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<a1572caf-4d57-4c7c-9250-636f19bfb73a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:16:35 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:35 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.base [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<a1572caf-4d57-4c7c-9250-636f19bfb73a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-39709060',display_name='tempest-ServerRescueNegativeTestJSON-server-39709060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-39709060',id=18,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-stsi9yrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:11:57Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=a1572caf-4d57-4c7c-9250-636f19bfb73a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:97:3a:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:97:3a:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.objects.base [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<a1572caf-4d57-4c7c-9250-636f19bfb73a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:16:35 user nova-compute[75326]:   <uuid>a1572caf-4d57-4c7c-9250-636f19bfb73a</uuid>
Dec 06 14:16:35 user nova-compute[75326]:   <name>instance-00000012</name>
Dec 06 14:16:35 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:16:35 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:16:35 user nova-compute[75326]:   <metadata>
Dec 06 14:16:35 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:16:35 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-39709060</nova:name>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:16:35</nova:creationTime>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:16:35 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:16:35 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:owner>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:16:35 user nova-compute[75326]:       </nova:owner>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:16:35 user nova-compute[75326]:       <nova:ports>
Dec 06 14:16:35 user nova-compute[75326]:         <nova:port uuid="6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7">
Dec 06 14:16:35 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:16:35 user nova-compute[75326]:         </nova:port>
Dec 06 14:16:35 user nova-compute[75326]:       </nova:ports>
Dec 06 14:16:35 user nova-compute[75326]:     </nova:instance>
Dec 06 14:16:35 user nova-compute[75326]:   </metadata>
Dec 06 14:16:35 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:16:35 user nova-compute[75326]:     <system>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="serial">a1572caf-4d57-4c7c-9250-636f19bfb73a</entry>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="uuid">a1572caf-4d57-4c7c-9250-636f19bfb73a</entry>
Dec 06 14:16:35 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:16:35 user nova-compute[75326]:     </system>
Dec 06 14:16:35 user nova-compute[75326]:   </sysinfo>
Dec 06 14:16:35 user nova-compute[75326]:   <os>
Dec 06 14:16:35 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:16:35 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:16:35 user nova-compute[75326]:   </os>
Dec 06 14:16:35 user nova-compute[75326]:   <features>
Dec 06 14:16:35 user nova-compute[75326]:     <acpi/>
Dec 06 14:16:35 user nova-compute[75326]:     <apic/>
Dec 06 14:16:35 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:16:35 user nova-compute[75326]:   </features>
Dec 06 14:16:35 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:16:35 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:16:35 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:16:35 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:16:35 user nova-compute[75326]:   </clock>
Dec 06 14:16:35 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:16:35 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:16:35 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:16:35 user nova-compute[75326]:   </cpu>
Dec 06 14:16:35 user nova-compute[75326]:   <devices>
Dec 06 14:16:35 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:16:35 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:16:35 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue"/>
Dec 06 14:16:35 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:16:35 user nova-compute[75326]:     </disk>
Dec 06 14:16:35 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:16:35 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:16:35 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk"/>
Dec 06 14:16:35 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:16:35 user nova-compute[75326]:     </disk>
Dec 06 14:16:35 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:16:35 user nova-compute[75326]:       <mac address="fa:16:3e:97:3a:8c"/>
Dec 06 14:16:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:35 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:16:35 user nova-compute[75326]:       <target dev="tap6a16eb4e-37"/>
Dec 06 14:16:35 user nova-compute[75326]:     </interface>
Dec 06 14:16:35 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:16:35 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/console.log" append="off"/>
Dec 06 14:16:35 user nova-compute[75326]:     </serial>
Dec 06 14:16:35 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:16:35 user nova-compute[75326]:     <video>
Dec 06 14:16:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:35 user nova-compute[75326]:     </video>
Dec 06 14:16:35 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:16:35 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:16:35 user nova-compute[75326]:     </rng>
Dec 06 14:16:35 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:16:35 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:16:35 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:16:35 user nova-compute[75326]:     </memballoon>
Dec 06 14:16:35 user nova-compute[75326]:   </devices>
Dec 06 14:16:35 user nova-compute[75326]: </domain>
Dec 06 14:16:35 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:16:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance destroyed successfully.
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:16:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:97:3a:8c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:36 user nova-compute[75326]: WARNING nova.compute.manager [req-f12e5904-17ea-4fe5-b297-322e6ca5d706 req-e69ed8ae-05b2-4098-b3db-743d64c45951 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state active and task_state rescuing.
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:16:36 user nova-compute[75326]: INFO nova.compute.claims [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Claim successful on node user
Dec 06 14:16:36 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:36 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Took 1.85 seconds to deallocate network for instance.
Dec 06 14:16:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.185s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:16:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:16:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:16:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Creating image(s)
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG nova.policy [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d7e6b93568f45c5bb4d5f2c660cfbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08132609a7b6464aa607ab2b5aa67eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:16:37 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Deleted allocations for instance 7007fec3-20a9-408b-ac10-067919ebab46
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8cde6844-1bda-47f8-a7ad-9cf854b66005 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "7007fec3-20a9-408b-ac10-067919ebab46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.445s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.240s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk 1073741824" returned: 0 in 0.054s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Cannot resize image /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Ensure instance console log exists: /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] [instance: 7007fec3-20a9-408b-ac10-067919ebab46] Received event network-vif-deleted-b9cd70bf-7ef4-4f7f-a9f7-8cb16753cdf1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:38 user nova-compute[75326]: WARNING nova.compute.manager [req-4c6d5646-ecc5-4ab9-88ed-d2cfb3704ca2 req-ad50ad48-157b-4cc6-a85d-2a3aa54125ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state active and task_state rescuing.
Dec 06 14:16:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-405cbdbe-9fa6-4ef2-9f28-fbb663e56e25 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:16:39 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Successfully created port: 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:16:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:40 user nova-compute[75326]: INFO nova.compute.manager [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Detaching volume e5086cbb-1e87-4d78-9269-08d5deb9144c
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:40 user nova-compute[75326]: WARNING nova.compute.manager [req-f0031781-cbcc-42e8-afe5-f5fc3d4180f1 req-d5f61aa1-74e2-4c69-bafe-063fa2d0ea2d service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state rescued and task_state None.
Dec 06 14:16:40 user nova-compute[75326]: INFO nova.virt.block_device [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Attempting to driver detach volume e5086cbb-1e87-4d78-9269-08d5deb9144c from mountpoint /dev/vdc
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Attempting to detach device vdc from instance 125c9956-52f2-465f-98b2-c6a9501f6387 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:16:40 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:16:40 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:16:40 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:16:40 user nova-compute[75326]:   <serial>e5086cbb-1e87-4d78-9269-08d5deb9144c</serial>
Dec 06 14:16:40 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:16:40 user nova-compute[75326]: </disk>
Dec 06 14:16:40 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:16:40 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully detached device vdc from instance 125c9956-52f2-465f-98b2-c6a9501f6387 from the persistent domain config.
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 125c9956-52f2-465f-98b2-c6a9501f6387 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:16:40 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:16:40 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:16:40 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:16:40 user nova-compute[75326]:   <serial>e5086cbb-1e87-4d78-9269-08d5deb9144c</serial>
Dec 06 14:16:40 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:16:40 user nova-compute[75326]: </disk>
Dec 06 14:16:40 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Successfully updated port: 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance network_info: |[{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start _get_guest_xml network_info=[{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:16:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-771152837',display_name='tempest-ServerStableDeviceRescueTest-server-771152837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-771152837',id=22,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiRKZiuA0wOtFrfJuBFo/XVJP+icvnqrfNzzZ0LGCt5xq1Csi4Kz1+swPwoQCgVKrcf4eLJD6lbTz4j1R2FQIU82S+oXapz4JT0edBe2UPUhAudhHKpLHXoEGmCS4ijLg==',key_name='tempest-keypair-2036139810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08132609a7b6464aa607ab2b5aa67eff',ramdisk_id='',reservation_id='r-gqnm3l0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1187090853',owner_user_name='tempest-ServerStableDeviceRescueTest-1187090853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d7e6b93568f45c5bb4d5f2c660cfbf6',uuid=2ccb172c-0758-42c4-ae72-7c115a8c36e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converting VIF {"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:16:41 user nova-compute[75326]:   <uuid>2ccb172c-0758-42c4-ae72-7c115a8c36e5</uuid>
Dec 06 14:16:41 user nova-compute[75326]:   <name>instance-00000016</name>
Dec 06 14:16:41 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:16:41 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:16:41 user nova-compute[75326]:   <metadata>
Dec 06 14:16:41 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:16:41 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-771152837</nova:name>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:16:41</nova:creationTime>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:16:41 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:16:41 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:owner>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:user uuid="0d7e6b93568f45c5bb4d5f2c660cfbf6">tempest-ServerStableDeviceRescueTest-1187090853-project-member</nova:user>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:project uuid="08132609a7b6464aa607ab2b5aa67eff">tempest-ServerStableDeviceRescueTest-1187090853</nova:project>
Dec 06 14:16:41 user nova-compute[75326]:       </nova:owner>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:16:41 user nova-compute[75326]:       <nova:ports>
Dec 06 14:16:41 user nova-compute[75326]:         <nova:port uuid="2954ec2e-e2ea-400c-8b68-79218917bc75">
Dec 06 14:16:41 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:16:41 user nova-compute[75326]:         </nova:port>
Dec 06 14:16:41 user nova-compute[75326]:       </nova:ports>
Dec 06 14:16:41 user nova-compute[75326]:     </nova:instance>
Dec 06 14:16:41 user nova-compute[75326]:   </metadata>
Dec 06 14:16:41 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:16:41 user nova-compute[75326]:     <system>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="serial">2ccb172c-0758-42c4-ae72-7c115a8c36e5</entry>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="uuid">2ccb172c-0758-42c4-ae72-7c115a8c36e5</entry>
Dec 06 14:16:41 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:16:41 user nova-compute[75326]:     </system>
Dec 06 14:16:41 user nova-compute[75326]:   </sysinfo>
Dec 06 14:16:41 user nova-compute[75326]:   <os>
Dec 06 14:16:41 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:16:41 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:16:41 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:16:41 user nova-compute[75326]:   </os>
Dec 06 14:16:41 user nova-compute[75326]:   <features>
Dec 06 14:16:41 user nova-compute[75326]:     <acpi/>
Dec 06 14:16:41 user nova-compute[75326]:     <apic/>
Dec 06 14:16:41 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:16:41 user nova-compute[75326]:   </features>
Dec 06 14:16:41 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:16:41 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:16:41 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:16:41 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:16:41 user nova-compute[75326]:   </clock>
Dec 06 14:16:41 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:16:41 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:16:41 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:16:41 user nova-compute[75326]:   </cpu>
Dec 06 14:16:41 user nova-compute[75326]:   <devices>
Dec 06 14:16:41 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:16:41 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:16:41 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk"/>
Dec 06 14:16:41 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:16:41 user nova-compute[75326]:     </disk>
Dec 06 14:16:41 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:16:41 user nova-compute[75326]:       <mac address="fa:16:3e:08:9e:30"/>
Dec 06 14:16:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:41 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:16:41 user nova-compute[75326]:       <target dev="tap2954ec2e-e2"/>
Dec 06 14:16:41 user nova-compute[75326]:     </interface>
Dec 06 14:16:41 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:16:41 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/console.log" append="off"/>
Dec 06 14:16:41 user nova-compute[75326]:     </serial>
Dec 06 14:16:41 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:16:41 user nova-compute[75326]:     <video>
Dec 06 14:16:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:41 user nova-compute[75326]:     </video>
Dec 06 14:16:41 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:16:41 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:16:41 user nova-compute[75326]:     </rng>
Dec 06 14:16:41 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:16:41 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:16:41 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:16:41 user nova-compute[75326]:     </memballoon>
Dec 06 14:16:41 user nova-compute[75326]:   </devices>
Dec 06 14:16:41 user nova-compute[75326]: </domain>
Dec 06 14:16:41 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-771152837',display_name='tempest-ServerStableDeviceRescueTest-server-771152837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-771152837',id=22,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiRKZiuA0wOtFrfJuBFo/XVJP+icvnqrfNzzZ0LGCt5xq1Csi4Kz1+swPwoQCgVKrcf4eLJD6lbTz4j1R2FQIU82S+oXapz4JT0edBe2UPUhAudhHKpLHXoEGmCS4ijLg==',key_name='tempest-keypair-2036139810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08132609a7b6464aa607ab2b5aa67eff',ramdisk_id='',reservation_id='r-gqnm3l0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1187090853',owner_user_name='tempest-ServerStableDeviceRescueTest-1187090853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d7e6b93568f45c5bb4d5f2c660cfbf6',uuid=2ccb172c-0758-42c4-ae72-7c115a8c36e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converting VIF {"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG os_vif [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00870759-2747-589f-82fa-eb317bfe3654', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2954ec2e-e2, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2954ec2e-e2, col_values=(('qos', UUID('5ebfc242-ec92-4013-8565-20b36093fdd2')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2954ec2e-e2, col_values=(('external_ids', {'iface-id': '2954ec2e-e2ea-400c-8b68-79218917bc75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:9e:30', 'vm-uuid': '2ccb172c-0758-42c4-ae72-7c115a8c36e5'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:41 user nova-compute[75326]: INFO os_vif [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2')
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:16:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No VIF found with MAC fa:16:3e:08:9e:30, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing instance network info cache due to event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:43 user nova-compute[75326]: WARNING nova.compute.manager [req-054c87cf-6427-4e8c-89a5-1916068661b7 req-6196e9c5-3d78-47d3-8ea2-ce02d9b72d59 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state building and task_state spawning.
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:16:43 user nova-compute[75326]: INFO nova.compute.claims [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Claim successful on node user
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updated VIF entry in instance network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.network.neutron [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b27e2387-5220-484e-9a85-564eb75f0649 req-649fb4a5-124b-4339-ae06-103cb2a0593e service nova] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:16:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:16:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG nova.policy [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584d6786de6449e7b07e35ca2a0a2291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea056f8f4348118fce811a5b38bbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:16:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Creating image(s)
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.249s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.235s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk 1073741824" returned: 0 in 0.065s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:16:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Successfully created port: b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Cannot resize image /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Ensure instance console log exists: /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:45 user nova-compute[75326]: WARNING nova.compute.manager [req-9ccb2e26-43c6-42e5-bafd-619a5ad3ea67 req-dfae5148-43c3-441d-bbf3-bc5c4f1752d5 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state building and task_state spawning.
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:16:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance spawned successfully.
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:45 user nova-compute[75326]: INFO nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Took 8.39 seconds to spawn the instance on the hypervisor.
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Successfully updated port: b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:16:45 user nova-compute[75326]: INFO nova.compute.manager [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Took 9.41 seconds to build instance.
Dec 06 14:16:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d2ff7fe-9b1a-48be-8238-ff5ff241889c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.555s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing instance network info cache due to event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Instance network_info: |[{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Start _get_guest_xml network_info=[{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:16:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-4521818',display_name='tempest-ServerActionsTestOtherA-server-4521818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-4521818',id=23,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-nk28wdyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.objects.instance [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'pci_devices' on Instance uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:16:46 user nova-compute[75326]:   <uuid>a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d</uuid>
Dec 06 14:16:46 user nova-compute[75326]:   <name>instance-00000017</name>
Dec 06 14:16:46 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:16:46 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:16:46 user nova-compute[75326]:   <metadata>
Dec 06 14:16:46 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:16:46 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherA-server-4521818</nova:name>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:16:46</nova:creationTime>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:16:46 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:16:46 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:owner>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:user uuid="584d6786de6449e7b07e35ca2a0a2291">tempest-ServerActionsTestOtherA-1568176033-project-member</nova:user>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:project uuid="fcea056f8f4348118fce811a5b38bbe3">tempest-ServerActionsTestOtherA-1568176033</nova:project>
Dec 06 14:16:46 user nova-compute[75326]:       </nova:owner>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:16:46 user nova-compute[75326]:       <nova:ports>
Dec 06 14:16:46 user nova-compute[75326]:         <nova:port uuid="b497ae2a-97d3-43e7-8741-fa8d1659aa69">
Dec 06 14:16:46 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 14:16:46 user nova-compute[75326]:         </nova:port>
Dec 06 14:16:46 user nova-compute[75326]:       </nova:ports>
Dec 06 14:16:46 user nova-compute[75326]:     </nova:instance>
Dec 06 14:16:46 user nova-compute[75326]:   </metadata>
Dec 06 14:16:46 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:16:46 user nova-compute[75326]:     <system>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="serial">a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d</entry>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="uuid">a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d</entry>
Dec 06 14:16:46 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:16:46 user nova-compute[75326]:     </system>
Dec 06 14:16:46 user nova-compute[75326]:   </sysinfo>
Dec 06 14:16:46 user nova-compute[75326]:   <os>
Dec 06 14:16:46 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:16:46 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:16:46 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:16:46 user nova-compute[75326]:   </os>
Dec 06 14:16:46 user nova-compute[75326]:   <features>
Dec 06 14:16:46 user nova-compute[75326]:     <acpi/>
Dec 06 14:16:46 user nova-compute[75326]:     <apic/>
Dec 06 14:16:46 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:16:46 user nova-compute[75326]:   </features>
Dec 06 14:16:46 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:16:46 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:16:46 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:16:46 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:16:46 user nova-compute[75326]:   </clock>
Dec 06 14:16:46 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:16:46 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:16:46 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:16:46 user nova-compute[75326]:   </cpu>
Dec 06 14:16:46 user nova-compute[75326]:   <devices>
Dec 06 14:16:46 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:16:46 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:16:46 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk"/>
Dec 06 14:16:46 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:16:46 user nova-compute[75326]:     </disk>
Dec 06 14:16:46 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:16:46 user nova-compute[75326]:       <mac address="fa:16:3e:ec:02:00"/>
Dec 06 14:16:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:46 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:16:46 user nova-compute[75326]:       <target dev="tapb497ae2a-97"/>
Dec 06 14:16:46 user nova-compute[75326]:     </interface>
Dec 06 14:16:46 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:16:46 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/console.log" append="off"/>
Dec 06 14:16:46 user nova-compute[75326]:     </serial>
Dec 06 14:16:46 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:16:46 user nova-compute[75326]:     <video>
Dec 06 14:16:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:16:46 user nova-compute[75326]:     </video>
Dec 06 14:16:46 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:16:46 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:16:46 user nova-compute[75326]:     </rng>
Dec 06 14:16:46 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:16:46 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:16:46 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:16:46 user nova-compute[75326]:     </memballoon>
Dec 06 14:16:46 user nova-compute[75326]:   </devices>
Dec 06 14:16:46 user nova-compute[75326]: </domain>
Dec 06 14:16:46 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-4521818',display_name='tempest-ServerActionsTestOtherA-server-4521818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-4521818',id=23,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-nk28wdyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG os_vif [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5343915f-4f7d-5c38-89a3-813c445b4186', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb497ae2a-97, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb497ae2a-97, col_values=(('qos', UUID('c1176f80-5cf5-4f7f-adb0-f927baed3fde')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb497ae2a-97, col_values=(('external_ids', {'iface-id': 'b497ae2a-97d3-43e7-8741-fa8d1659aa69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:02:00', 'vm-uuid': 'a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:46 user nova-compute[75326]: INFO os_vif [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97')
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:ec:02:00, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated VIF entry in instance network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:16:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-475aae08-e5d0-4774-83a2-4b5433abe382 req-e35d15ac-fad1-4759-97cc-8c7169ce72ca service nova] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:16:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] No waiting events found dispatching network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:48 user nova-compute[75326]: WARNING nova.compute.manager [req-0a58222a-95a7-4606-b794-b79cf8f0ff07 req-8e70c90c-7ef1-42a2-b228-b5e8ac897a99 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received unexpected event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 for instance with vm_state building and task_state spawning.
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:16:50 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Instance spawned successfully.
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] No waiting events found dispatching network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:16:50 user nova-compute[75326]: WARNING nova.compute.manager [req-7df662ce-1736-4ef1-8c57-e1f48dde3ada req-f4477a1d-26cc-427b-b61e-e00aac8483e3 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received unexpected event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 for instance with vm_state building and task_state spawning.
Dec 06 14:16:50 user nova-compute[75326]: INFO nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Took 6.76 seconds to spawn the instance on the hypervisor.
Dec 06 14:16:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:16:50 user nova-compute[75326]: INFO nova.compute.manager [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Took 7.68 seconds to build instance.
Dec 06 14:16:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-96982c10-f663-40be-9d8c-a902c2a6b819 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.850s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:16:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:16:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:01 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 125c9956-52f2-465f-98b2-c6a9501f6387 is timed out.
Dec 06 14:17:01 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully detached device vdc from instance 125c9956-52f2-465f-98b2-c6a9501f6387 from the live domain config.
Dec 06 14:17:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVmsFEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:17:01 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112df2e-2377-4237-82a7-931dc4c570c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:17:01 user nova-compute[75326]: No targets found.
Dec 06 14:17:01 user nova-compute[75326]: iSNS:
Dec 06 14:17:01 user nova-compute[75326]: No targets found.
Dec 06 14:17:01 user nova-compute[75326]: STATIC:
Dec 06 14:17:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:17:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:17:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c
Dec 06 14:17:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e
Dec 06 14:17:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:01 user nova-compute[75326]: FIRMWARE:
Dec 06 14:17:01 user nova-compute[75326]: No targets found.
Dec 06 14:17:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:17:01 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:17:01 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ade2e-8c3e-456d-beae-de727b296d12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8df387-cb19-434f-92a9-da774ab4c413]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:01 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc12a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66acac6-b138-4aa2-aaac-f1a42387c100]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5f855-b2a1-4919-a758-3990cb8d9c5c]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b00f83-1c52-41e1-a524-7215bcbaa926]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c791b89-1437-42f6-81c4-2b96e22016f6]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a407074-c713-4792-a36a-ae0909cf2a91]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6fdcd-e6e2-4be1-baac-a36901bfa2c2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260]
Dec 06 14:17:01 user nova-compute[75326]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c, portal: 172.16.0.220,3260] successful.
Dec 06 14:17:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5086cbb-1e87-4d78-9269-08d5deb9144c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[80620ef1-330c-4e08-801d-7a0d8707e2e3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] <== disconnect_volume: return (377ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:17:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:17:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'flavor' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3c7ee87-a250-4385-bff8-2ee494b84a4c tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.254s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:17:14 user nova-compute[75326]: INFO nova.compute.claims [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Claim successful on node user
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:17:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:17:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Creating image(s)
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "/opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "/opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "/opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG nova.policy [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60a9ed63f2b04f8cb9616a6394be48b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20585cba38541d88671fc0448e0c686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk 1073741824" returned: 0 in 0.056s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Cannot resize image /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Ensure instance console log exists: /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:17:15 user nova-compute[75326]: INFO nova.compute.claims [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Claim successful on node user
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:17:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.policy [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ea783d27940479b9d78a93500062e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56d8164e56e499c90eca8cb27e98bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:17:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Creating image(s)
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "/opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Successfully created port: 61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-changed-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing instance network info cache due to event network-changed-b2e6387d-91f5-4eb8-9e89-df1eae2757b7. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] Acquiring lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] Acquired lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Refreshing network info cache for port b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk 1073741824" returned: 0 in 0.061s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Cannot resize image /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Ensure instance console log exists: /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updated VIF entry in instance network info cache for port b2e6387d-91f5-4eb8-9e89-df1eae2757b7. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b042d72-cd35-42c4-bc69-9b0b3e4d20c9 req-1945e136-2e3c-47b4-b093-638a5b3b2a6d service nova] Releasing lock "refresh_cache-380bf541-d329-4557-8951-6b68ba52ae0a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Successfully created port: ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Successfully updated port: 61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquired lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing instance network info cache due to event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:17:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] Acquiring lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Releasing lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Instance network_info: |[{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] Acquired lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Start _get_guest_xml network_info=[{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:17:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1405228567',display_name='tempest-TestStampPattern-server-1405228567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1405228567',id=24,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-yoaaz0sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:15Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'pci_devices' on Instance uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:17:18 user nova-compute[75326]:   <uuid>076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9</uuid>
Dec 06 14:17:18 user nova-compute[75326]:   <name>instance-00000018</name>
Dec 06 14:17:18 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:17:18 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:17:18 user nova-compute[75326]:   <metadata>
Dec 06 14:17:18 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:17:18 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:name>tempest-TestStampPattern-server-1405228567</nova:name>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:17:18</nova:creationTime>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:17:18 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:17:18 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:owner>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:user uuid="60a9ed63f2b04f8cb9616a6394be48b9">tempest-TestStampPattern-690937075-project-member</nova:user>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:project uuid="c20585cba38541d88671fc0448e0c686">tempest-TestStampPattern-690937075</nova:project>
Dec 06 14:17:18 user nova-compute[75326]:       </nova:owner>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:17:18 user nova-compute[75326]:       <nova:ports>
Dec 06 14:17:18 user nova-compute[75326]:         <nova:port uuid="61d4b3a6-f21e-40c6-bc27-993e5ea837fd">
Dec 06 14:17:18 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 14:17:18 user nova-compute[75326]:         </nova:port>
Dec 06 14:17:18 user nova-compute[75326]:       </nova:ports>
Dec 06 14:17:18 user nova-compute[75326]:     </nova:instance>
Dec 06 14:17:18 user nova-compute[75326]:   </metadata>
Dec 06 14:17:18 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:17:18 user nova-compute[75326]:     <system>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="serial">076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9</entry>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="uuid">076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9</entry>
Dec 06 14:17:18 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:17:18 user nova-compute[75326]:     </system>
Dec 06 14:17:18 user nova-compute[75326]:   </sysinfo>
Dec 06 14:17:18 user nova-compute[75326]:   <os>
Dec 06 14:17:18 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:17:18 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:17:18 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:17:18 user nova-compute[75326]:   </os>
Dec 06 14:17:18 user nova-compute[75326]:   <features>
Dec 06 14:17:18 user nova-compute[75326]:     <acpi/>
Dec 06 14:17:18 user nova-compute[75326]:     <apic/>
Dec 06 14:17:18 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:17:18 user nova-compute[75326]:   </features>
Dec 06 14:17:18 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:17:18 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:17:18 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:17:18 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:17:18 user nova-compute[75326]:   </clock>
Dec 06 14:17:18 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:17:18 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:17:18 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:17:18 user nova-compute[75326]:   </cpu>
Dec 06 14:17:18 user nova-compute[75326]:   <devices>
Dec 06 14:17:18 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:17:18 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:17:18 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk"/>
Dec 06 14:17:18 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:17:18 user nova-compute[75326]:     </disk>
Dec 06 14:17:18 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:17:18 user nova-compute[75326]:       <mac address="fa:16:3e:48:0d:83"/>
Dec 06 14:17:18 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:18 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:17:18 user nova-compute[75326]:       <target dev="tap61d4b3a6-f2"/>
Dec 06 14:17:18 user nova-compute[75326]:     </interface>
Dec 06 14:17:18 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:17:18 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/console.log" append="off"/>
Dec 06 14:17:18 user nova-compute[75326]:     </serial>
Dec 06 14:17:18 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:17:18 user nova-compute[75326]:     <video>
Dec 06 14:17:18 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:18 user nova-compute[75326]:     </video>
Dec 06 14:17:18 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:17:18 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:17:18 user nova-compute[75326]:     </rng>
Dec 06 14:17:18 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:17:18 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:17:18 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:17:18 user nova-compute[75326]:     </memballoon>
Dec 06 14:17:18 user nova-compute[75326]:   </devices>
Dec 06 14:17:18 user nova-compute[75326]: </domain>
Dec 06 14:17:18 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1405228567',display_name='tempest-TestStampPattern-server-1405228567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1405228567',id=24,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-yoaaz0sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:15Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG os_vif [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1f91839-4383-5cae-abf7-99fea8141759', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61d4b3a6-f2, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61d4b3a6-f2, col_values=(('qos', UUID('d294e40d-2647-4ed8-bf08-8cf8e658192a')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61d4b3a6-f2, col_values=(('external_ids', {'iface-id': '61d4b3a6-f21e-40c6-bc27-993e5ea837fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0d:83', 'vm-uuid': '076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:18 user nova-compute[75326]: INFO os_vif [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2')
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:17:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No VIF found with MAC fa:16:3e:48:0d:83, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Successfully updated port: ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquired lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updated VIF entry in instance network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82898680-e835-4537-b7d9-c2575a2b36b2 req-62907f87-4627-4daf-aed4-4f22d84490ef service nova] Releasing lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updating instance_info_cache with network_info: [{"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Releasing lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Instance network_info: |[{"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:17:19 user nova-compute[75326]: INFO nova.compute.manager [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Terminating instance
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Start _get_guest_xml network_info=[{"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:17:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-811489441',display_name='tempest-AttachVolumeNegativeTest-server-811489441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-811489441',id=25,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnGe+E8hNSJLMxTa/lSPNCv82sqyYQOhdLSSn+MksDur2qlroWZkDgAK0m/VU2NHrD4ZbKo5WTVGeDTr/KTZhI2RWDjiksdyE0qylDb1jCS87s8qia6ct9wvNGij/LUCA==',key_name='tempest-keypair-1825592576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-65y0w7c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=bb123c3e-1a86-4051-bf1d-70ed6d7c6f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.objects.instance [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'pci_devices' on Instance uuid bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:17:19 user nova-compute[75326]:   <uuid>bb123c3e-1a86-4051-bf1d-70ed6d7c6f50</uuid>
Dec 06 14:17:19 user nova-compute[75326]:   <name>instance-00000019</name>
Dec 06 14:17:19 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:17:19 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:17:19 user nova-compute[75326]:   <metadata>
Dec 06 14:17:19 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:17:19 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeNegativeTest-server-811489441</nova:name>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:17:19</nova:creationTime>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:17:19 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:17:19 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:owner>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:user uuid="6ea783d27940479b9d78a93500062e8e">tempest-AttachVolumeNegativeTest-1014509330-project-member</nova:user>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:project uuid="f56d8164e56e499c90eca8cb27e98bf9">tempest-AttachVolumeNegativeTest-1014509330</nova:project>
Dec 06 14:17:19 user nova-compute[75326]:       </nova:owner>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:17:19 user nova-compute[75326]:       <nova:ports>
Dec 06 14:17:19 user nova-compute[75326]:         <nova:port uuid="ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86">
Dec 06 14:17:19 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:17:19 user nova-compute[75326]:         </nova:port>
Dec 06 14:17:19 user nova-compute[75326]:       </nova:ports>
Dec 06 14:17:19 user nova-compute[75326]:     </nova:instance>
Dec 06 14:17:19 user nova-compute[75326]:   </metadata>
Dec 06 14:17:19 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:17:19 user nova-compute[75326]:     <system>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="serial">bb123c3e-1a86-4051-bf1d-70ed6d7c6f50</entry>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="uuid">bb123c3e-1a86-4051-bf1d-70ed6d7c6f50</entry>
Dec 06 14:17:19 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:17:19 user nova-compute[75326]:     </system>
Dec 06 14:17:19 user nova-compute[75326]:   </sysinfo>
Dec 06 14:17:19 user nova-compute[75326]:   <os>
Dec 06 14:17:19 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:17:19 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:17:19 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:17:19 user nova-compute[75326]:   </os>
Dec 06 14:17:19 user nova-compute[75326]:   <features>
Dec 06 14:17:19 user nova-compute[75326]:     <acpi/>
Dec 06 14:17:19 user nova-compute[75326]:     <apic/>
Dec 06 14:17:19 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:17:19 user nova-compute[75326]:   </features>
Dec 06 14:17:19 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:17:19 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:17:19 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:17:19 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:17:19 user nova-compute[75326]:   </clock>
Dec 06 14:17:19 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:17:19 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:17:19 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:17:19 user nova-compute[75326]:   </cpu>
Dec 06 14:17:19 user nova-compute[75326]:   <devices>
Dec 06 14:17:19 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:17:19 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:17:19 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk"/>
Dec 06 14:17:19 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:17:19 user nova-compute[75326]:     </disk>
Dec 06 14:17:19 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:17:19 user nova-compute[75326]:       <mac address="fa:16:3e:69:1f:6d"/>
Dec 06 14:17:19 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:19 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:17:19 user nova-compute[75326]:       <target dev="tapebb31cc4-82"/>
Dec 06 14:17:19 user nova-compute[75326]:     </interface>
Dec 06 14:17:19 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:17:19 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/console.log" append="off"/>
Dec 06 14:17:19 user nova-compute[75326]:     </serial>
Dec 06 14:17:19 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:17:19 user nova-compute[75326]:     <video>
Dec 06 14:17:19 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:19 user nova-compute[75326]:     </video>
Dec 06 14:17:19 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:17:19 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:17:19 user nova-compute[75326]:     </rng>
Dec 06 14:17:19 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:17:19 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:17:19 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:17:19 user nova-compute[75326]:     </memballoon>
Dec 06 14:17:19 user nova-compute[75326]:   </devices>
Dec 06 14:17:19 user nova-compute[75326]: </domain>
Dec 06 14:17:19 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-811489441',display_name='tempest-AttachVolumeNegativeTest-server-811489441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-811489441',id=25,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnGe+E8hNSJLMxTa/lSPNCv82sqyYQOhdLSSn+MksDur2qlroWZkDgAK0m/VU2NHrD4ZbKo5WTVGeDTr/KTZhI2RWDjiksdyE0qylDb1jCS87s8qia6ct9wvNGij/LUCA==',key_name='tempest-keypair-1825592576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-65y0w7c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=bb123c3e-1a86-4051-bf1d-70ed6d7c6f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG os_vif [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7264f2c-7918-540f-b2d9-9bc05fa6c03c', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb31cc4-82, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb31cc4-82, col_values=(('qos', UUID('ac6c9284-d077-4874-8cc0-832b7f0725bd')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb31cc4-82, col_values=(('external_ids', {'iface-id': 'ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:1f:6d', 'vm-uuid': 'bb123c3e-1a86-4051-bf1d-70ed6d7c6f50'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-changed-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Refreshing instance network info cache due to event network-changed-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] Acquiring lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] Acquired lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Refreshing network info cache for port ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: INFO os_vif [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82')
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:69:1f:6d, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-af5e6221-bfe8-4f71-a316-50081f20524d req-31ba7826-3ce4-42d3-9784-f81229f377b0 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updated VIF entry in instance network info cache for port ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updating instance_info_cache with network_info: [{"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04ed4360-467d-42ac-a115-5d38641a6c20 req-aa558965-f129-4539-8560-a6e053121e03 service nova] Releasing lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-092d238e-7c5c-40d7-8938-43a2384c3d60 req-69b5f003-f6df-4a09-b790-7eee4da60b20 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Instance destroyed successfully.
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lazy-loading 'resources' on Instance uuid 380bf541-d329-4557-8951-6b68ba52ae0a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2e6387d-91, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdb036ae-af85-4716-983b-9e73bc97ad46) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fe:90,bridge_name='br-int',has_traffic_filtering=True,id=b2e6387d-91f5-4eb8-9e89-df1eae2757b7,network=Network(f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e6387d-91')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44fc6e77-bc, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-5329d86d-1f81-4df7-a193-ac0dceb4af73 for instance with vm_state active and task_state deleting.
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-66959599-49a9-42a9-887d-2206cabb1ae3 req-5db5a968-1dd7-4593-92e0-64cae65551ee service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-f7b98710-b96d-4d30-95b2-92da5a751ebb for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7cb91c0-efa4-4ce9-b607-4388ee07f6d0) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44fc6e77-bc')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc95fcd04-a3, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf280d2b-c7c7-409b-b071-8e6a991a73ee) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=c95fcd04-a3c2-4d59-afb9-09e39d4a6056,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc95fcd04-a3')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 for instance with vm_state active and task_state deleting.
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0 for instance with vm_state active and task_state deleting.
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] No waiting events found dispatching network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received unexpected event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd for instance with vm_state building and task_state spawning.
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] No waiting events found dispatching network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING nova.compute.manager [req-6f959204-8c35-449a-bb20-c0d84a75ab38 req-4116c585-a872-4421-9788-f72ed0601839 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received unexpected event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd for instance with vm_state building and task_state spawning.
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a23ff4-4d, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b3b91cb-34dd-4f24-b699-8fbcc2cbf86d) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c3:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3a23ff4-4d5e-415d-abc8-1c0afb775035,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a23ff4-4d')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "address": "fa:16:3e:1f:00:b8", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de16f62-f4", "ovs_interfaceid": "0de16f62-f49a-48a1-bcce-4ba2625f59fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0de16f62-f4, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8b0122-9aea-4f97-b90d-940afe38d743) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:00:b8,bridge_name='br-int',has_traffic_filtering=True,id=0de16f62-f49a-48a1-bcce-4ba2625f59fb,network=Network(fb6b49f6-e5aa-40a2-848a-c781f2b2df39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de16f62-f4')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5329d86d-1f, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7c0204e-8041-43ac-9228-dd79dd9516e3) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bf:0d,bridge_name='br-int',has_traffic_filtering=True,id=5329d86d-1f81-4df7-a193-ac0dceb4af73,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5329d86d-1f')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-963809231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-963809231',id=21,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7q4tg/ozw7/HJ1cqaSNW9kycU8GYn5Psxy8UAXGJEKmzPI4BXnaU3CzmgbJIyltTcPuxsywBfTmuepWDt9GB6hzlK1qadzpUc7YvBVMX+yPpsOLbSYSlIYOaz7yzf6mw==',key_name='tempest-keypair-761755398',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09066ffaa044edfbcd83596cb8fdc28',ramdisk_id='',reservation_id='r-htqr2erp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-288640949',owner_user_name='tempest-TaggedBootDevicesTest_v242-288640949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad63ce1fea1b43ce92d4261a1a8ec20b',uuid=380bf541-d329-4557-8951-6b68ba52ae0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converting VIF {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7b98710-b9, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b90772-f4bf-41c0-beab-926c58f1c8ac) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:22 user nova-compute[75326]: INFO os_vif [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4e:06,bridge_name='br-int',has_traffic_filtering=True,id=f7b98710-b96d-4d30-95b2-92da5a751ebb,network=Network(d09aec43-16fb-423f-8fbe-3dcb97dd758e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b98710-b9')
Dec 06 14:17:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnKQXgPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:17:22 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad398e7a-35a7-459d-9a09-f5ed7e0fdaf4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:17:22 user nova-compute[75326]: No targets found.
Dec 06 14:17:22 user nova-compute[75326]: iSNS:
Dec 06 14:17:22 user nova-compute[75326]: No targets found.
Dec 06 14:17:22 user nova-compute[75326]: STATIC:
Dec 06 14:17:22 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:17:22 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:22 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:22 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:17:22 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:22 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:22 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e
Dec 06 14:17:22 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:22 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:22 user nova-compute[75326]: FIRMWARE:
Dec 06 14:17:22 user nova-compute[75326]: No targets found.
Dec 06 14:17:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:17:22 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:17:22 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5073f-d1e8-4a49-9c5b-decb8e7098a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d9976e-7989-4024-a12f-1c0921d12b7d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:17:22 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:22 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e (non-flash)
Dec 06 14:17:22 user nova-compute[75326]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:22 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd4c7cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51e806-95db-44d1-b112-2e2a46701625]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb539463-62a8-4534-83e7-a11041ad8b8e]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5f4feb-1401-47d9-8387-ab8af6496b5b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4fa13-1d9d-448d-9d40-9338d51d8532]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dea2e0-529e-4621-a3f8-f1ec694f1f3b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[380a300b-b983-4ce7-bf1a-88cf8200b732]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260]
Dec 06 14:17:23 user nova-compute[75326]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e, portal: 172.16.0.220,3260] successful.
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c5aee-640b-4e95-a242-f779ac74a20e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8efbc11-fe02-4c6e-8a8a-787d454ac5a7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== disconnect_volume: return (373ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeIqavSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:17:23 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfb669-0e35-4b64-9427-5325c8ae472f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]: iSNS:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]: STATIC:
Dec 06 14:17:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:17:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e
Dec 06 14:17:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:23 user nova-compute[75326]: FIRMWARE:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:17:23 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:17:23 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d815c7d-1954-40c1-befc-b79c374cf4d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67493ddd-ee9f-4d71-8f8d-00abf988222b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:23 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e (non-flash)
Dec 06 14:17:23 user nova-compute[75326]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd4c7cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e'): ({'sdf'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Removing single pathed devices sdf {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace44dd-8974-4344-b243-3fa5383d8d62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88c830-67fd-4a0b-b758-86777ed5622f]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Flushing IO for device /dev/sdf {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05bacb-1d34-43a2-9a80-dd28ce793ca6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919fb41-70df-4eac-b984-fee44f06fd2d]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] SCSI volumes sdf have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea3dd98-54dc-4d29-a959-9b9b3b9bbca6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd342d4-c7b3-4d79-8499-25d5ea317e7e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260]
Dec 06 14:17:23 user nova-compute[75326]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e, portal: 172.16.0.220,3260] successful.
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35f8a256-16ac-4c2a-b234-edb6fd1ffd2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f244f7d1-63c5-432a-af73-b93699860acb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== disconnect_volume: return (314ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzqjnMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:17:23 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ef91f-3a7e-45d5-b86b-f7d068036cc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]: iSNS:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]: STATIC:
Dec 06 14:17:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044
Dec 06 14:17:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:17:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:17:23 user nova-compute[75326]: FIRMWARE:
Dec 06 14:17:23 user nova-compute[75326]: No targets found.
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:17:23 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:17:23 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f69067c-67d9-46dd-af33-172e2731c057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2a7e0-0f8e-4f72-a1ca-84753b2aebec]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 (non-flash)
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40f8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044'): ({'sdg'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Removing single pathed devices sdg {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a21673-2814-4faf-86d3-4afceedc7658]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e89590-1bd0-468a-addc-8ac0b74f1dd1]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Flushing IO for device /dev/sdg {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4a804-9d6c-43e3-9bba-96c6a5290986]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:23 user nova-compute[75326]: WARNING nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c95fcd04-a3c2-4d59-afb9-09e39d4a6056 for instance with vm_state active and task_state deleting.
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:23 user nova-compute[75326]: WARNING nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-c3a23ff4-4d5e-415d-abc8-1c0afb775035 for instance with vm_state active and task_state deleting.
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-unplugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-unplugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:23 user nova-compute[75326]: WARNING nova.compute.manager [req-ea24f6c3-9c3c-4f69-9dd5-ad74e9c903ac req-508d95b1-f1ae-404b-a380-700b7d86b7c5 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-0de16f62-f49a-48a1-bcce-4ba2625f59fb for instance with vm_state active and task_state deleting.
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6368eb47-0af8-481c-906c-69ddea1bcb97]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] SCSI volumes sdg have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b20c3-1878-4ba8-80e5-461375fc1e0d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501117d-6c2e-401a-8e53-fe8d0bf8aec2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260]
Dec 06 14:17:23 user nova-compute[75326]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044, portal: 172.16.0.220,3260] successful.
Dec 06 14:17:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3b9232-c669-4534-a3dc-0b28ccdae044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f64dd5-fc82-48ed-b994-ae59bf67732c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] <== disconnect_volume: return (361ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:17:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Deleting instance files /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a_del
Dec 06 14:17:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Deletion of /opt/stack/data/nova/instances/380bf541-d329-4557-8951-6b68ba52ae0a_del complete
Dec 06 14:17:23 user nova-compute[75326]: INFO nova.compute.manager [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Took 4.25 seconds to destroy the instance on the hypervisor.
Dec 06 14:17:23 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:17:23 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Instance spawned successfully.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Took 9.48 seconds to spawn the instance on the hypervisor.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] Acquiring lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] Lock "380bf541-d329-4557-8951-6b68ba52ae0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] No waiting events found dispatching network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:24 user nova-compute[75326]: WARNING nova.compute.manager [req-2b60567f-b17c-4c6b-9dd7-af7644f63629 req-8f39ad0f-d514-415c-8e0b-96a27a1f2e32 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received unexpected event network-vif-plugged-f7b98710-b96d-4d30-95b2-92da5a751ebb for instance with vm_state active and task_state deleting.
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.compute.manager [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Took 10.24 seconds to build instance.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8ad68c4a-090e-4ea5-af0a-88c65c68d2ac tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.360s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Instance spawned successfully.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Took 8.22 seconds to spawn the instance on the hypervisor.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:17:24 user nova-compute[75326]: INFO nova.compute.manager [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Took 8.98 seconds to build instance.
Dec 06 14:17:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68f0284d-d441-47f0-8348-f14591e18ba3 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.098s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-da73ab4f-0ba5-459c-9f00-797cd989163b req-eff82d0a-daba-4d61-a6bc-7c441813b319 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-deleted-0de16f62-f49a-48a1-bcce-4ba2625f59fb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:28 user nova-compute[75326]: INFO nova.compute.manager [req-da73ab4f-0ba5-459c-9f00-797cd989163b req-eff82d0a-daba-4d61-a6bc-7c441813b319 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Neutron deleted interface 0de16f62-f49a-48a1-bcce-4ba2625f59fb; detaching it from the instance and deleting it from the info cache
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-da73ab4f-0ba5-459c-9f00-797cd989163b req-eff82d0a-daba-4d61-a6bc-7c441813b319 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "address": "fa:16:3e:1a:bf:0d", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5329d86d-1f", "ovs_interfaceid": "5329d86d-1f81-4df7-a193-ac0dceb4af73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-da73ab4f-0ba5-459c-9f00-797cd989163b req-eff82d0a-daba-4d61-a6bc-7c441813b319 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Detach interface failed, port_id=0de16f62-f49a-48a1-bcce-4ba2625f59fb, reason: Instance 380bf541-d329-4557-8951-6b68ba52ae0a could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:17:28 user nova-compute[75326]: INFO nova.compute.claims [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Claim successful on node user
Dec 06 14:17:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:17:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] No waiting events found dispatching network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:29 user nova-compute[75326]: WARNING nova.compute.manager [req-f6e3db56-2089-42e8-8a6c-0e12c6aed2e1 req-b96adf86-18f3-4ac3-babe-021be45f662d service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received unexpected event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 for instance with vm_state active and task_state None.
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.policy [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '691bec5c3db54e5d8bedc6193b976c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c49428c1da4c6592df6be7874c46f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:17:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Creating image(s)
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "/opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "/opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.222s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.261s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk 1073741824" returned: 0 in 0.065s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:17:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-deleted-5329d86d-1f81-4df7-a193-ac0dceb4af73 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:30 user nova-compute[75326]: INFO nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Neutron deleted interface 5329d86d-1f81-4df7-a193-ac0dceb4af73; detaching it from the instance and deleting it from the info cache
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "address": "fa:16:3e:30:c3:c2", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a23ff4-4d", "ovs_interfaceid": "c3a23ff4-4d5e-415d-abc8-1c0afb775035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Cannot resize image /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Detach interface failed, port_id=5329d86d-1f81-4df7-a193-ac0dceb4af73, reason: Instance 380bf541-d329-4557-8951-6b68ba52ae0a could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-deleted-c3a23ff4-4d5e-415d-abc8-1c0afb775035 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:30 user nova-compute[75326]: INFO nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Neutron deleted interface c3a23ff4-4d5e-415d-abc8-1c0afb775035; detaching it from the instance and deleting it from the info cache
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "address": "fa:16:3e:4e:4e:06", "network": {"id": "d09aec43-16fb-423f-8fbe-3dcb97dd758e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1883843222", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b98710-b9", "ovs_interfaceid": "f7b98710-b96d-4d30-95b2-92da5a751ebb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Detach interface failed, port_id=c3a23ff4-4d5e-415d-abc8-1c0afb775035, reason: Instance 380bf541-d329-4557-8951-6b68ba52ae0a could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-deleted-f7b98710-b96d-4d30-95b2-92da5a751ebb {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:30 user nova-compute[75326]: INFO nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Neutron deleted interface f7b98710-b96d-4d30-95b2-92da5a751ebb; detaching it from the instance and deleting it from the info cache
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [{"id": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "address": "fa:16:3e:7e:fe:90", "network": {"id": "f71c3fc0-edcf-40c4-af1d-ecd5bc8dca74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-440760844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e6387d-91", "ovs_interfaceid": "b2e6387d-91f5-4eb8-9e89-df1eae2757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "address": "fa:16:3e:3e:ec:16", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44fc6e77-bc", "ovs_interfaceid": "44fc6e77-bc6c-4597-bb6f-d72b1e14a2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "address": "fa:16:3e:48:f6:08", "network": {"id": "fb6b49f6-e5aa-40a2-848a-c781f2b2df39", "bridge": "br-int", "label": "tempest-device-tagging-net1-1336056010", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f09066ffaa044edfbcd83596cb8fdc28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95fcd04-a3", "ovs_interfaceid": "c95fcd04-a3c2-4d59-afb9-09e39d4a6056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-7d2bf735-14f8-4d08-baa1-c17f07405456 req-23896f68-2e7d-409d-988f-28cc29d0a5b2 service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Detach interface failed, port_id=f7b98710-b96d-4d30-95b2-92da5a751ebb, reason: Instance 380bf541-d329-4557-8951-6b68ba52ae0a could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:17:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Successfully created port: 94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:31 user nova-compute[75326]: INFO nova.compute.manager [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Terminating instance
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] No waiting events found dispatching network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:31 user nova-compute[75326]: WARNING nova.compute.manager [req-84e248f3-2dbe-4f8a-b735-4c77bc061d7b req-67b405a1-3dbe-42e8-a493-9f2120ae63b4 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received unexpected event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 for instance with vm_state active and task_state None.
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:17:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Instance destroyed successfully.
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'resources' on Instance uuid 125c9956-52f2-465f-98b2-c6a9501f6387 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1949009546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1949009546',id=15,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3sFuyyzk/u1BsOvoxYJHJzYzfvV/tbfuX4WOqFK41kPQDgOP3iSJqQ9JGWzgR4KoZAI6CTxMRFLHCmKrn+nmCZdDiugZYmnRwd5OmUBe5uIa6zBLN3K81LNegUcIKOPg==',key_name='tempest-keypair-1968467179',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-v0cn4ooy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=125c9956-52f2-465f-98b2-c6a9501f6387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "address": "fa:16:3e:f9:c7:5a", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafcbd3d-b6", "ovs_interfaceid": "bafcbd3d-b6ae-4d10-b52c-7546970b3d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG os_vif [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbafcbd3d-b6, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a8df86e-c82b-4afe-94c3-7f0e484271ca) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:31 user nova-compute[75326]: INFO os_vif [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c7:5a,bridge_name='br-int',has_traffic_filtering=True,id=bafcbd3d-b6ae-4d10-b52c-7546970b3d65,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafcbd3d-b6')
Dec 06 14:17:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Deleting instance files /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387_del
Dec 06 14:17:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Deletion of /opt/stack/data/nova/instances/125c9956-52f2-465f-98b2-c6a9501f6387_del complete
Dec 06 14:17:31 user nova-compute[75326]: INFO nova.compute.manager [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 14:17:31 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:17:31 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:32 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Took 8.31 seconds to deallocate network for instance.
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-unplugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-1135f5de-c339-4e14-8af8-3b51f942be3b req-562656e4-2573-4d0a-b443-e0ef214d92bd service nova] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Received event network-vif-deleted-b2e6387d-91f5-4eb8-9e89-df1eae2757b7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Successfully updated port: 94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquired lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:32 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:33 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Took 1.03 seconds to deallocate network for instance.
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-f43185e6-a845-4705-93f1-88a571182661 req-525e067b-f8b1-476a-aec6-a7009794aea8 service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-deleted-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating instance_info_cache with network_info: [{"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Releasing lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Instance network_info: |[{"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Start _get_guest_xml network_info=[{"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:17:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1891786937',display_name='tempest-AttachVolumeTestJSON-server-1891786937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1891786937',id=26,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCQaP8OASBFHQAjz97e9RXy0/6FgXUtBGK4aKGM4uG8Ihmn9jNxpB4ba8DabKdd2DWbPJGJZw4OrS3JoAu6cCJEPT4tiZkIK5UHITo2msCezojooLrbrkLhswTLIZbrw==',key_name='tempest-keypair-1838938509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-40vgdxf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=fcd18b74-f5a2-4782-8a8f-bc9012497546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:17:33 user nova-compute[75326]:   <uuid>fcd18b74-f5a2-4782-8a8f-bc9012497546</uuid>
Dec 06 14:17:33 user nova-compute[75326]:   <name>instance-0000001a</name>
Dec 06 14:17:33 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:17:33 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:17:33 user nova-compute[75326]:   <metadata>
Dec 06 14:17:33 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:17:33 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeTestJSON-server-1891786937</nova:name>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:17:33</nova:creationTime>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:17:33 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:17:33 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:owner>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:user uuid="691bec5c3db54e5d8bedc6193b976c01">tempest-AttachVolumeTestJSON-653396495-project-member</nova:user>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:project uuid="83c49428c1da4c6592df6be7874c46f7">tempest-AttachVolumeTestJSON-653396495</nova:project>
Dec 06 14:17:33 user nova-compute[75326]:       </nova:owner>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:17:33 user nova-compute[75326]:       <nova:ports>
Dec 06 14:17:33 user nova-compute[75326]:         <nova:port uuid="94713f4b-10e5-4130-b9eb-ffa20c7cada9">
Dec 06 14:17:33 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 14:17:33 user nova-compute[75326]:         </nova:port>
Dec 06 14:17:33 user nova-compute[75326]:       </nova:ports>
Dec 06 14:17:33 user nova-compute[75326]:     </nova:instance>
Dec 06 14:17:33 user nova-compute[75326]:   </metadata>
Dec 06 14:17:33 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:17:33 user nova-compute[75326]:     <system>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="serial">fcd18b74-f5a2-4782-8a8f-bc9012497546</entry>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="uuid">fcd18b74-f5a2-4782-8a8f-bc9012497546</entry>
Dec 06 14:17:33 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:17:33 user nova-compute[75326]:     </system>
Dec 06 14:17:33 user nova-compute[75326]:   </sysinfo>
Dec 06 14:17:33 user nova-compute[75326]:   <os>
Dec 06 14:17:33 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:17:33 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:17:33 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:17:33 user nova-compute[75326]:   </os>
Dec 06 14:17:33 user nova-compute[75326]:   <features>
Dec 06 14:17:33 user nova-compute[75326]:     <acpi/>
Dec 06 14:17:33 user nova-compute[75326]:     <apic/>
Dec 06 14:17:33 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:17:33 user nova-compute[75326]:   </features>
Dec 06 14:17:33 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:17:33 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:17:33 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:17:33 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:17:33 user nova-compute[75326]:   </clock>
Dec 06 14:17:33 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:17:33 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:17:33 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:17:33 user nova-compute[75326]:   </cpu>
Dec 06 14:17:33 user nova-compute[75326]:   <devices>
Dec 06 14:17:33 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:17:33 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:17:33 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk"/>
Dec 06 14:17:33 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:17:33 user nova-compute[75326]:     </disk>
Dec 06 14:17:33 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:17:33 user nova-compute[75326]:       <mac address="fa:16:3e:41:34:dc"/>
Dec 06 14:17:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:33 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:17:33 user nova-compute[75326]:       <target dev="tap94713f4b-10"/>
Dec 06 14:17:33 user nova-compute[75326]:     </interface>
Dec 06 14:17:33 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:17:33 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/console.log" append="off"/>
Dec 06 14:17:33 user nova-compute[75326]:     </serial>
Dec 06 14:17:33 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:17:33 user nova-compute[75326]:     <video>
Dec 06 14:17:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:33 user nova-compute[75326]:     </video>
Dec 06 14:17:33 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:17:33 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:17:33 user nova-compute[75326]:     </rng>
Dec 06 14:17:33 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:17:33 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:17:33 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:17:33 user nova-compute[75326]:     </memballoon>
Dec 06 14:17:33 user nova-compute[75326]:   </devices>
Dec 06 14:17:33 user nova-compute[75326]: </domain>
Dec 06 14:17:33 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1891786937',display_name='tempest-AttachVolumeTestJSON-server-1891786937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1891786937',id=26,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCQaP8OASBFHQAjz97e9RXy0/6FgXUtBGK4aKGM4uG8Ihmn9jNxpB4ba8DabKdd2DWbPJGJZw4OrS3JoAu6cCJEPT4tiZkIK5UHITo2msCezojooLrbrkLhswTLIZbrw==',key_name='tempest-keypair-1838938509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-40vgdxf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=fcd18b74-f5a2-4782-8a8f-bc9012497546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG os_vif [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26dc5c9d-ffcd-5735-aba7-57f1d8fa3cb9', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94713f4b-10, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94713f4b-10, col_values=(('qos', UUID('25feeb54-d9e4-45c9-9b39-eae90bd69224')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94713f4b-10, col_values=(('external_ids', {'iface-id': '94713f4b-10e5-4130-b9eb-ffa20c7cada9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:34:dc', 'vm-uuid': 'fcd18b74-f5a2-4782-8a8f-bc9012497546'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:33 user nova-compute[75326]: INFO os_vif [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10')
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No VIF found with MAC fa:16:3e:41:34:dc, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '125c9956-52f2-465f-98b2-c6a9501f6387' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '125c9956-52f2-465f-98b2-c6a9501f6387' (instance-0000000f)
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.009s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:34 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Deleted allocations for instance 125c9956-52f2-465f-98b2-c6a9501f6387
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e89ac1a4-0369-4f3f-a06d-2a88e5570325 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "125c9956-52f2-465f-98b2-c6a9501f6387" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Acquiring lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Lock "125c9956-52f2-465f-98b2-c6a9501f6387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] No waiting events found dispatching network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:34 user nova-compute[75326]: WARNING nova.compute.manager [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: 125c9956-52f2-465f-98b2-c6a9501f6387] Received unexpected event network-vif-plugged-bafcbd3d-b6ae-4d10-b52c-7546970b3d65 for instance with vm_state deleted and task_state None.
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-changed-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Refreshing instance network info cache due to event network-changed-94713f4b-10e5-4130-b9eb-ffa20c7cada9. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Acquiring lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Acquired lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Refreshing network info cache for port 94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updated VIF entry in instance network info cache for port 94713f4b-10e5-4130-b9eb-ffa20c7cada9. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating instance_info_cache with network_info: [{"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dd89aadb-9317-4c5d-b31d-47004a46c630 req-0f28b01a-174a-40d1-811b-51135baf839d service nova] Releasing lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:35 user nova-compute[75326]: INFO nova.compute.manager [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] [instance: 380bf541-d329-4557-8951-6b68ba52ae0a] Took 3.01 seconds to detach 3 volumes for instance.
Dec 06 14:17:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:36 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:36 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.56501007080078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.881s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.204s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:36 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Deleted allocations for instance 380bf541-d329-4557-8951-6b68ba52ae0a
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ae2923f6-b597-4932-aead-9069917f58d0 tempest-TaggedBootDevicesTest_v242-288640949 tempest-TaggedBootDevicesTest_v242-288640949-project-member] Lock "380bf541-d329-4557-8951-6b68ba52ae0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.720s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance fcd18b74-f5a2-4782-8a8f-bc9012497546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] No waiting events found dispatching network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:36 user nova-compute[75326]: WARNING nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received unexpected event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 for instance with vm_state building and task_state spawning.
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] No waiting events found dispatching network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:36 user nova-compute[75326]: WARNING nova.compute.manager [req-60da4a73-d02d-4540-aff1-5826abe56ca6 req-0c85d939-6b66-406c-b293-8ae79888d0e4 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received unexpected event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 for instance with vm_state building and task_state spawning.
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.519s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:36 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:17:36 user nova-compute[75326]: INFO nova.compute.claims [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Claim successful on node user
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:17:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.policy [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c053c2d147df4c959d5cffa31dc2490c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e022afe38348fd87bc8b16175e1f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:17:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Creating image(s)
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "1cd1be2b5b76671d13f741d5c4746b335e852452" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "1cd1be2b5b76671d13f741d5c4746b335e852452" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:17:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Instance spawned successfully.
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:38 user nova-compute[75326]: INFO nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Took 8.96 seconds to spawn the instance on the hypervisor.
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Successfully created port: ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:17:38 user nova-compute[75326]: INFO nova.compute.manager [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Took 9.86 seconds to build instance.
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8d1f383b-32f4-49f4-b8ee-090b5b1dc5a1 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.010s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.virt.images [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] 888a41b0-1feb-4344-b96d-971dc84333e3 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.part /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:17:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.part /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.converted" returned: 0 in 1.545s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Successfully updated port: ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "1cd1be2b5b76671d13f741d5c4746b335e852452" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.690s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.compute.manager [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing instance network info cache due to event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "1cd1be2b5b76671d13f741d5c4746b335e852452" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "1cd1be2b5b76671d13f741d5c4746b335e852452" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance network_info: |[{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452,backing_fmt=raw /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452,backing_fmt=raw /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk 1073741824" returned: 0 in 0.054s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "1cd1be2b5b76671d13f741d5c4746b335e852452" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Cannot resize image /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Ensure instance console log exists: /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start _get_guest_xml network_info=[{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:17:32Z,direct_url=<?>,disk_format='qcow2',id=888a41b0-1feb-4344-b96d-971dc84333e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1340377985',owner='44e022afe38348fd87bc8b16175e1f09',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:17:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '888a41b0-1feb-4344-b96d-971dc84333e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:17:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updated VIF entry in instance network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.neutron [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:17:32Z,direct_url=<?>,disk_format='qcow2',id=888a41b0-1feb-4344-b96d-971dc84333e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1340377985',owner='44e022afe38348fd87bc8b16175e1f09',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:17:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:37Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'pci_devices' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13daffc9-5b53-4b4e-a06e-e47ca70ed947 req-5b739427-df60-4627-b55f-24ad875295fc service nova] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:17:40 user nova-compute[75326]:   <uuid>7626a81f-f1bc-4aef-be81-b5979fc9bbcb</uuid>
Dec 06 14:17:40 user nova-compute[75326]:   <name>instance-0000001b</name>
Dec 06 14:17:40 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:17:40 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:17:40 user nova-compute[75326]:   <metadata>
Dec 06 14:17:40 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:17:40 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:name>tempest-TestMinimumBasicScenario-server-843579329</nova:name>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:17:40</nova:creationTime>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:17:40 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:17:40 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:owner>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:user uuid="c053c2d147df4c959d5cffa31dc2490c">tempest-TestMinimumBasicScenario-1988051507-project-member</nova:user>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:project uuid="44e022afe38348fd87bc8b16175e1f09">tempest-TestMinimumBasicScenario-1988051507</nova:project>
Dec 06 14:17:40 user nova-compute[75326]:       </nova:owner>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:root type="image" uuid="888a41b0-1feb-4344-b96d-971dc84333e3"/>
Dec 06 14:17:40 user nova-compute[75326]:       <nova:ports>
Dec 06 14:17:40 user nova-compute[75326]:         <nova:port uuid="ef51fec1-2bd2-4742-bbb6-8c54c05e06bd">
Dec 06 14:17:40 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 14:17:40 user nova-compute[75326]:         </nova:port>
Dec 06 14:17:40 user nova-compute[75326]:       </nova:ports>
Dec 06 14:17:40 user nova-compute[75326]:     </nova:instance>
Dec 06 14:17:40 user nova-compute[75326]:   </metadata>
Dec 06 14:17:40 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:17:40 user nova-compute[75326]:     <system>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="serial">7626a81f-f1bc-4aef-be81-b5979fc9bbcb</entry>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="uuid">7626a81f-f1bc-4aef-be81-b5979fc9bbcb</entry>
Dec 06 14:17:40 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:17:40 user nova-compute[75326]:     </system>
Dec 06 14:17:40 user nova-compute[75326]:   </sysinfo>
Dec 06 14:17:40 user nova-compute[75326]:   <os>
Dec 06 14:17:40 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:17:40 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:17:40 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:17:40 user nova-compute[75326]:   </os>
Dec 06 14:17:40 user nova-compute[75326]:   <features>
Dec 06 14:17:40 user nova-compute[75326]:     <acpi/>
Dec 06 14:17:40 user nova-compute[75326]:     <apic/>
Dec 06 14:17:40 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:17:40 user nova-compute[75326]:   </features>
Dec 06 14:17:40 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:17:40 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:17:40 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:17:40 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:17:40 user nova-compute[75326]:   </clock>
Dec 06 14:17:40 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:17:40 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:17:40 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:17:40 user nova-compute[75326]:   </cpu>
Dec 06 14:17:40 user nova-compute[75326]:   <devices>
Dec 06 14:17:40 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:17:40 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:17:40 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk"/>
Dec 06 14:17:40 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:17:40 user nova-compute[75326]:     </disk>
Dec 06 14:17:40 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:17:40 user nova-compute[75326]:       <mac address="fa:16:3e:97:ea:aa"/>
Dec 06 14:17:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:40 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:17:40 user nova-compute[75326]:       <target dev="tapef51fec1-2b"/>
Dec 06 14:17:40 user nova-compute[75326]:     </interface>
Dec 06 14:17:40 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:17:40 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/console.log" append="off"/>
Dec 06 14:17:40 user nova-compute[75326]:     </serial>
Dec 06 14:17:40 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:17:40 user nova-compute[75326]:     <video>
Dec 06 14:17:40 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:17:40 user nova-compute[75326]:     </video>
Dec 06 14:17:40 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:17:40 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:17:40 user nova-compute[75326]:     </rng>
Dec 06 14:17:40 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:17:40 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:17:40 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:17:40 user nova-compute[75326]:     </memballoon>
Dec 06 14:17:40 user nova-compute[75326]:   </devices>
Dec 06 14:17:40 user nova-compute[75326]: </domain>
Dec 06 14:17:40 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:17:37Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG os_vif [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a71684c9-b375-57f3-ac5c-1e3b8327b29b', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef51fec1-2b, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef51fec1-2b, col_values=(('qos', UUID('ade4371b-d360-41af-b269-b152776c5879')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef51fec1-2b, col_values=(('external_ids', {'iface-id': 'ef51fec1-2bd2-4742-bbb6-8c54c05e06bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:ea:aa', 'vm-uuid': '7626a81f-f1bc-4aef-be81-b5979fc9bbcb'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:17:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:40 user nova-compute[75326]: INFO os_vif [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b')
Dec 06 14:17:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:17:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No VIF found with MAC fa:16:3e:97:ea:aa, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:42 user nova-compute[75326]: WARNING nova.compute.manager [req-cb0b6197-3c41-43d3-a6dd-a8e7baa94cfd req-8c64ec80-9b5f-4d65-b547-bfeef7202b47 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state building and task_state spawning.
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:17:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance spawned successfully.
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:17:44 user nova-compute[75326]: WARNING nova.compute.manager [req-712c349b-099b-4c7f-a6bd-96fc6085616e req-f8531bc1-6b8e-431c-af60-0be70339eca2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state building and task_state spawning.
Dec 06 14:17:44 user nova-compute[75326]: INFO nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Took 7.29 seconds to spawn the instance on the hypervisor.
Dec 06 14:17:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:17:44 user nova-compute[75326]: INFO nova.compute.manager [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Took 8.54 seconds to build instance.
Dec 06 14:17:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a0f79bd-aa25-4686-a190-8babb75b39b4 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.654s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:17:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:17:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:23 user nova-compute[75326]: INFO nova.compute.manager [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Unrescuing
Dec 06 14:18:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:18:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:18:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'flavor' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:24 user nova-compute[75326]: WARNING nova.compute.manager [req-599886c7-7a0f-4918-ab0a-1853b85d05fa req-360e06f2-d22b-45b8-9947-acc425fff2ba service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:18:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance destroyed successfully.
Dec 06 14:18:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:18:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:18:25 user nova-compute[75326]: INFO nova.compute.claims [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Claim successful on node user
Dec 06 14:18:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:18:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.policy [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '921ceb47e4174eb0b5a47fe727d4a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c14bbf4b604b6282ec7c5e925c2514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:26 user nova-compute[75326]: WARNING nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:26 user nova-compute[75326]: WARNING nova.compute.manager [req-6d6f2cd1-5a6e-4900-8bd0-31a34c05ff9e req-8f1cfd17-8766-44ad-b0c2-f5460611fe22 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:18:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Creating image(s)
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk 1073741824" returned: 0 in 0.060s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Successfully created port: b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Cannot resize image /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Successfully updated port: b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing instance network info cache due to event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance network_info: |[{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start _get_guest_xml network_info=[{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:18:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:18:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvA7c2M/dNfeZX/7DVkmjUtVFHsXll6qoNszwh/Ws48lSDFoMCbAYmQB78PXMLbrZ4Xf86khlAvf5S9iUTkCJs6lcoOi2Gx0DD9s8NwwDYYoCUrKTCpmCWIvaQGzlMXiA==',key_name='tempest-keypair-606551783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_devices' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:18:28 user nova-compute[75326]:   <uuid>aae09742-d2f6-4291-bd41-0337df3ce9c1</uuid>
Dec 06 14:18:28 user nova-compute[75326]:   <name>instance-0000001c</name>
Dec 06 14:18:28 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:18:28 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:18:28 user nova-compute[75326]:   <metadata>
Dec 06 14:18:28 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:18:28 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1098097890</nova:name>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:18:28</nova:creationTime>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:18:28 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:18:28 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:owner>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:user uuid="921ceb47e4174eb0b5a47fe727d4a1d2">tempest-AttachVolumeShelveTestJSON-82698496-project-member</nova:user>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:project uuid="f7c14bbf4b604b6282ec7c5e925c2514">tempest-AttachVolumeShelveTestJSON-82698496</nova:project>
Dec 06 14:18:28 user nova-compute[75326]:       </nova:owner>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:18:28 user nova-compute[75326]:       <nova:ports>
Dec 06 14:18:28 user nova-compute[75326]:         <nova:port uuid="b5ea5d62-6081-4079-b059-c45be12249c6">
Dec 06 14:18:28 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:18:28 user nova-compute[75326]:         </nova:port>
Dec 06 14:18:28 user nova-compute[75326]:       </nova:ports>
Dec 06 14:18:28 user nova-compute[75326]:     </nova:instance>
Dec 06 14:18:28 user nova-compute[75326]:   </metadata>
Dec 06 14:18:28 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:18:28 user nova-compute[75326]:     <system>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="serial">aae09742-d2f6-4291-bd41-0337df3ce9c1</entry>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="uuid">aae09742-d2f6-4291-bd41-0337df3ce9c1</entry>
Dec 06 14:18:28 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:18:28 user nova-compute[75326]:     </system>
Dec 06 14:18:28 user nova-compute[75326]:   </sysinfo>
Dec 06 14:18:28 user nova-compute[75326]:   <os>
Dec 06 14:18:28 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:18:28 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:18:28 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:18:28 user nova-compute[75326]:   </os>
Dec 06 14:18:28 user nova-compute[75326]:   <features>
Dec 06 14:18:28 user nova-compute[75326]:     <acpi/>
Dec 06 14:18:28 user nova-compute[75326]:     <apic/>
Dec 06 14:18:28 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:18:28 user nova-compute[75326]:   </features>
Dec 06 14:18:28 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:18:28 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:18:28 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:18:28 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:18:28 user nova-compute[75326]:   </clock>
Dec 06 14:18:28 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:18:28 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:18:28 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:18:28 user nova-compute[75326]:   </cpu>
Dec 06 14:18:28 user nova-compute[75326]:   <devices>
Dec 06 14:18:28 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:18:28 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:18:28 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk"/>
Dec 06 14:18:28 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:18:28 user nova-compute[75326]:     </disk>
Dec 06 14:18:28 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:18:28 user nova-compute[75326]:       <mac address="fa:16:3e:a7:f8:40"/>
Dec 06 14:18:28 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:18:28 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:18:28 user nova-compute[75326]:       <target dev="tapb5ea5d62-60"/>
Dec 06 14:18:28 user nova-compute[75326]:     </interface>
Dec 06 14:18:28 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:18:28 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/console.log" append="off"/>
Dec 06 14:18:28 user nova-compute[75326]:     </serial>
Dec 06 14:18:28 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:18:28 user nova-compute[75326]:     <video>
Dec 06 14:18:28 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:18:28 user nova-compute[75326]:     </video>
Dec 06 14:18:28 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:18:28 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:18:28 user nova-compute[75326]:     </rng>
Dec 06 14:18:28 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:18:28 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:18:28 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:18:28 user nova-compute[75326]:     </memballoon>
Dec 06 14:18:28 user nova-compute[75326]:   </devices>
Dec 06 14:18:28 user nova-compute[75326]: </domain>
Dec 06 14:18:28 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvA7c2M/dNfeZX/7DVkmjUtVFHsXll6qoNszwh/Ws48lSDFoMCbAYmQB78PXMLbrZ4Xf86khlAvf5S9iUTkCJs6lcoOi2Gx0DD9s8NwwDYYoCUrKTCpmCWIvaQGzlMXiA==',key_name='tempest-keypair-606551783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG os_vif [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b37010bb-bb0d-50ce-95fd-eabec9a9f215', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5ea5d62-60, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5ea5d62-60, col_values=(('qos', UUID('f9d07a8a-b513-49cd-a2f5-20b93580bb26')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5ea5d62-60, col_values=(('external_ids', {'iface-id': 'b5ea5d62-6081-4079-b059-c45be12249c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f8:40', 'vm-uuid': 'aae09742-d2f6-4291-bd41-0337df3ce9c1'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: INFO os_vif [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60')
Dec 06 14:18:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b7ecb0b2-b548-435f-a808-2bac20fa222b tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:28 user nova-compute[75326]: WARNING nova.compute.manager [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing instance network info cache due to event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No VIF found with MAC fa:16:3e:a7:f8:40, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updated VIF entry in instance network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:18:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2aaf7f59-8306-435b-918a-0450eeb09e27 req-83f41b5d-3da6-4d2d-a44a-58fc16f2c2dd service nova] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG nova.network.neutron [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updated VIF entry in instance network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG nova.network.neutron [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0476aac0-ed66-43ba-842e-584a5b0a4298 req-2ff9578a-a1d7-491e-a365-24758615af68 service nova] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:18:30 user nova-compute[75326]: INFO nova.compute.manager [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] instance snapshotting
Dec 06 14:18:30 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Beginning live snapshot process
Dec 06 14:18:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:30 user nova-compute[75326]: WARNING nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state building and task_state spawning.
Dec 06 14:18:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:18:30 user nova-compute[75326]: WARNING nova.compute.manager [req-608220d0-5879-488e-b133-60b620782b72 req-48b36025-814b-46ef-b9a9-7af2249b3a1c service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state building and task_state spawning.
Dec 06 14:18:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.204s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08.delta 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08.delta 1073741824" returned: 0 in 0.057s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 14:18:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:18:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 14:18:32 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:18:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08.delta /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:18:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance spawned successfully.
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:33 user nova-compute[75326]: INFO nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Took 6.57 seconds to spawn the instance on the hypervisor.
Dec 06 14:18:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:33 user nova-compute[75326]: INFO nova.compute.manager [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Took 7.63 seconds to build instance.
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a79404b1-3144-42a4-9d7e-450b688467da tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.761s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08.delta /opt/stack/data/nova/instances/snapshots/tmp14shn44p/c03f3cee99464d51b0b4a7d509315d08" returned: 0 in 0.613s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Snapshot extracted, beginning image upload
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing instance network info cache due to event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated VIF entry in instance network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8f8192d3-befa-4271-b958-f86f8cd75fe1 req-8940e5ad-fc6a-4dd4-b67f-df30101ef034 service nova] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Snapshot image upload complete
Dec 06 14:18:37 user nova-compute[75326]: INFO nova.compute.manager [None req-8f1e2efa-cc1b-450e-a0ef-d945e3887606 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Took 6.60 seconds to snapshot the instance on the hypervisor.
Dec 06 14:18:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:18:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:18:37 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:18:38 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7718MB free_disk=25.403404235839844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance fcd18b74-f5a2-4782-8a8f-bc9012497546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance aae09742-d2f6-4291-bd41-0337df3ce9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:18:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:18:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing instance network info cache due to event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] Acquiring lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] Acquired lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updated VIF entry in instance network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bbb63ec2-862c-4805-83bb-b26a99795f88 req-f7e5b896-350f-4c20-9f02-3a1f9dceebb7 service nova] Releasing lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:06 user nova-compute[75326]: INFO nova.compute.manager [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Attaching volume c867fa5c-8a5b-4692-91db-26de0e1ee6d2 to /dev/vdb
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.utils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69728090-c0d0-4ed5-8eb2-1d91016a23f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f381eed-e657-43cb-a911-8c0749bf647f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c494b97-6158-4f21-bf5c-dc2713585032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ee331-d32f-4d39-b7dc-4803980d5c43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-changed-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Refreshing instance network info cache due to event network-changed-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] Acquiring lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] Acquired lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.network.neutron [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Refreshing network info cache for port ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:06 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:19:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc89758-0c2e-438d-aace-adf45cf2b830]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG os_brick.utils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:06 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating existing volume attachment record: cb206465-7b64-4bc8-b453-d721e7f7a071 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:19:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updated VIF entry in instance network info cache for port ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updating instance_info_cache with network_info: [{"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-122837ed-9d19-49c5-aa44-c17fce9ef578 req-bee76c47-81ad-4835-8541-0d27f52a96aa service nova] Releasing lock "refresh_cache-bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG nova.objects.instance [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:09 user nova-compute[75326]: INFO nova.compute.manager [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Attaching volume 05a56412-f3af-44fa-8455-65eb84bad674 to /dev/vdb
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.utils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefdc856-6b6b-4e18-8cec-1ec1cb33ff2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd8e9c-d2f2-4f18-a86d-e55f3d466a7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f54190e-d964-4b98-9626-c6089c805f5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[909a0fa3-270f-47fd-a98f-d53460b6ec2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:09 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:19:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f5fa3-17f6-43a4-927d-f08f8f11f679]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG os_brick.utils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:09 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updating existing volume attachment record: 397159df-0a0f-4e4b-92a0-ae634ffedfbb {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:19:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEULHibl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:16 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f194cb1-1179-423f-98fa-89f410b179f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:16 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ce952-9a6c-4d05-aeb8-86eed7f8e42e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2] added
Dec 06 14:19:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d28774-2c07-47a7-8cd0-579f371b65f4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d72768-73a4-48cf-8acb-456b15635da8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEULHibl {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEULHibl" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54b492-1a1f-4722-b6f2-54acd19340e9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEULHibl'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[76513ee4-048d-4b58-8c85-1b2e9299afa2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c2947c-1f35-497d-aa80-69b9b4623811]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:19:17 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:19:17 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:17 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 14:19:17 user nova-compute[75326]: 
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5985259-6ad0-455f-a614-48cf0f804ecc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260]
Dec 06 14:19:17 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c7227-b507-4bb8-86b1-dff32210c112]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ff6325-536f-446d-a579-2b383c483d10]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.039s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed3c979-0cbe-4386-bcef-59abde4d9f98]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:19:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEULHibl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26239366335363037', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239366335363037', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:19:18 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:18 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:19:18 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:18 user nova-compute[75326]:   <serial>c867fa5c-8a5b-4692-91db-26de0e1ee6d2</serial>
Dec 06 14:19:18 user nova-compute[75326]: </disk>
Dec 06 14:19:18 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No VIF found with MAC fa:16:3e:48:0d:83, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-18696425-da4c-4120-a40e-504357e402d1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.360s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-changed-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Refreshing instance network info cache due to event network-changed-94713f4b-10e5-4130-b9eb-ffa20c7cada9. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] Acquiring lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] Acquired lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Refreshing network info cache for port 94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbLaPkfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:19 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15abe5d-7789-4d51-ad7f-874f38b44dc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:20 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a90652-1b68-425b-9622-5bce515af39c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674] added
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d2a611-a26c-4ebd-8f07-125f4b311729]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[132f28dc-f9ee-45b3-985b-5de06f5fd5cb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbLaPkfw {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbLaPkfw" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767bc6c-02c6-4504-b0d0-8107752fa228]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JbLaPkfw'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4ed548-3fae-4c6f-9396-3fef458aee4f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f9019-07fe-4f30-a917-fdaa0a713b12]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f56abb-bc14-4861-ab7c-0564b65889f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260]
Dec 06 14:19:20 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909796c-3267-415b-8905-77b0587c4068]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7b458-535f-4527-ae10-a373832acc6d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42fb25-b4cc-4636-bb15-1bd62e908ecb]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbLaPkfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updated VIF entry in instance network info cache for port 94713f4b-10e5-4130-b9eb-ffa20c7cada9. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating instance_info_cache with network_info: [{"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c577b8c-174c-4b4a-a5b9-36f2f2aa1bde req-adf91555-ee0d-4baf-bfef-4a5e8e50ca9d service nova] Releasing lock "refresh_cache-fcd18b74-f5a2-4782-8a8f-bc9012497546" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26434663733353733', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434663733353733', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:19:21 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:21 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:19:21 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:21 user nova-compute[75326]:   <serial>05a56412-f3af-44fa-8455-65eb84bad674</serial>
Dec 06 14:19:21 user nova-compute[75326]: </disk>
Dec 06 14:19:21 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:21 user nova-compute[75326]: INFO nova.compute.manager [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Detaching volume c867fa5c-8a5b-4692-91db-26de0e1ee6d2
Dec 06 14:19:21 user nova-compute[75326]: INFO nova.virt.block_device [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Attempting to driver detach volume c867fa5c-8a5b-4692-91db-26de0e1ee6d2 from mountpoint /dev/vdb
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Attempting to detach device vdb from instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:21 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:21 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:19:21 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:21 user nova-compute[75326]:   <serial>c867fa5c-8a5b-4692-91db-26de0e1ee6d2</serial>
Dec 06 14:19:21 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:21 user nova-compute[75326]: </disk>
Dec 06 14:19:21 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully detached device vdb from instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 from the persistent domain config.
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:21 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:21 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:19:21 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:21 user nova-compute[75326]:   <serial>c867fa5c-8a5b-4692-91db-26de0e1ee6d2</serial>
Dec 06 14:19:21 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:21 user nova-compute[75326]: </disk>
Dec 06 14:19:21 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] No VIF found with MAC fa:16:3e:69:1f:6d, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-dc536fb6-ad1c-4e6b-8182-3d2b6ee96663 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.235s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:23 user nova-compute[75326]: INFO nova.compute.manager [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Detaching volume 05a56412-f3af-44fa-8455-65eb84bad674
Dec 06 14:19:23 user nova-compute[75326]: INFO nova.virt.block_device [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Attempting to driver detach volume 05a56412-f3af-44fa-8455-65eb84bad674 from mountpoint /dev/vdb
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Attempting to detach device vdb from instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:23 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:23 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:19:23 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:23 user nova-compute[75326]:   <serial>05a56412-f3af-44fa-8455-65eb84bad674</serial>
Dec 06 14:19:23 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:23 user nova-compute[75326]: </disk>
Dec 06 14:19:23 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 from the persistent domain config.
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:23 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:23 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:19:23 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:23 user nova-compute[75326]:   <serial>05a56412-f3af-44fa-8455-65eb84bad674</serial>
Dec 06 14:19:23 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:23 user nova-compute[75326]: </disk>
Dec 06 14:19:23 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:23 user nova-compute[75326]: INFO nova.compute.manager [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attaching volume a75e1ea4-3d88-480d-97e1-f31a4be1395d to /dev/vdb
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.utils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636b4af-e52c-46f6-a0a1-68b92d0c72c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d90ac-cf12-4bfa-aa04-6a9708143c0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b50518b-0df1-4db4-be29-0e37bd9d521b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7fee49-c64a-4b39-b42c-5f0eebb2105b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:23 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:19:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1f853-e41e-4eff-8131-0a1e462ddd70]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG os_brick.utils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:23 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating existing volume attachment record: 50a274af-bcb2-40ed-a2d1-8296902d74d2 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:19:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:29 user nova-compute[75326]: INFO nova.compute.manager [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Attaching volume 5382d6ae-49b4-41be-978a-7eee414e5d0e to /dev/vdb
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.utils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3fe597-bfe9-4e9c-922e-572281033a13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f191d2cf-90bd-43a8-a2fa-85d6abd33a0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd926e-d271-4a38-afaf-4ce5b39cd2b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[013bfd32-6bac-4ca1-ba98-728a6799ccea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:29 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:19:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7eb2d-c6f4-414a-899e-56c3b43456c7]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG os_brick.utils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:29 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating existing volume attachment record: ddfb0a6b-5835-4d32-9897-db4adde06706 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:19:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:19:32 user nova-compute[75326]: INFO nova.compute.claims [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Claim successful on node user
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.276s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:19:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.policy [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61037bed82704e35b06d34c6835dbcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42606f35dde84948b771234dc36c558d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:19:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Creating image(s)
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "/opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "/opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk 1073741824" returned: 0 in 0.058s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Successfully created port: 244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Cannot resize image /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Ensure instance console log exists: /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvmRdAzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:34 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a9d4c8-acc2-4551-9def-d0eab368627c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:34 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c31b4-fe51-46ee-9b71-4961a16f8185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d] added
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d08ed4-6006-4434-9e9b-545a9da78f89]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.085s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837ac93-957f-466a-963b-e1da42aac678]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvmRdAzM {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvmRdAzM" returned: 0 in 0.039s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f655c6-38c5-4a50-9bbc-04ca4ca430f8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvmRdAzM'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31383c-2b4f-4e8d-8810-0466b64ea9f6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e361ebd-2b27-4e5d-9c41-1dc4b41d0479]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06194d45-c9e6-41dc-afdf-efbcf407b077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260]
Dec 06 14:19:34 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43ca5f-24d3-4c9e-b9c4-80816af788ed]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485c9f5-814b-4ef7-baf5-b635f2cc730f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:34 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3f8315-ba27-4b1a-b29a-9ad2c401f966]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvmRdAzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Successfully updated port: 244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquired lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-changed-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Refreshing instance network info cache due to event network-changed-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] Acquiring lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Updating instance_info_cache with network_info: [{"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Releasing lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Instance network_info: |[{"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] Acquired lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Refreshing network info cache for port 244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Start _get_guest_xml network_info=[{"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:19:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:19:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671987779',display_name='tempest-VolumesActionsTest-instance-671987779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671987779',id=29,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-rkcs1360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:19:33Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=9ff062df-5a61-4b89-8547-b668913bf4b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ff062df-5a61-4b89-8547-b668913bf4b8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:19:35 user nova-compute[75326]:   <uuid>9ff062df-5a61-4b89-8547-b668913bf4b8</uuid>
Dec 06 14:19:35 user nova-compute[75326]:   <name>instance-0000001d</name>
Dec 06 14:19:35 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:19:35 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:19:35 user nova-compute[75326]:   <metadata>
Dec 06 14:19:35 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:19:35 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:name>tempest-VolumesActionsTest-instance-671987779</nova:name>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:19:34</nova:creationTime>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:19:35 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:19:35 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:owner>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:user uuid="61037bed82704e35b06d34c6835dbcb1">tempest-VolumesActionsTest-969285127-project-member</nova:user>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:project uuid="42606f35dde84948b771234dc36c558d">tempest-VolumesActionsTest-969285127</nova:project>
Dec 06 14:19:35 user nova-compute[75326]:       </nova:owner>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:19:35 user nova-compute[75326]:       <nova:ports>
Dec 06 14:19:35 user nova-compute[75326]:         <nova:port uuid="244649c3-bbeb-42cc-bd9f-a8a94bfc27d1">
Dec 06 14:19:35 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 14:19:35 user nova-compute[75326]:         </nova:port>
Dec 06 14:19:35 user nova-compute[75326]:       </nova:ports>
Dec 06 14:19:35 user nova-compute[75326]:     </nova:instance>
Dec 06 14:19:35 user nova-compute[75326]:   </metadata>
Dec 06 14:19:35 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:19:35 user nova-compute[75326]:     <system>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="serial">9ff062df-5a61-4b89-8547-b668913bf4b8</entry>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="uuid">9ff062df-5a61-4b89-8547-b668913bf4b8</entry>
Dec 06 14:19:35 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:19:35 user nova-compute[75326]:     </system>
Dec 06 14:19:35 user nova-compute[75326]:   </sysinfo>
Dec 06 14:19:35 user nova-compute[75326]:   <os>
Dec 06 14:19:35 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:19:35 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:19:35 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:19:35 user nova-compute[75326]:   </os>
Dec 06 14:19:35 user nova-compute[75326]:   <features>
Dec 06 14:19:35 user nova-compute[75326]:     <acpi/>
Dec 06 14:19:35 user nova-compute[75326]:     <apic/>
Dec 06 14:19:35 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:19:35 user nova-compute[75326]:   </features>
Dec 06 14:19:35 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:19:35 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:19:35 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:19:35 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:19:35 user nova-compute[75326]:   </clock>
Dec 06 14:19:35 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:19:35 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:19:35 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:19:35 user nova-compute[75326]:   </cpu>
Dec 06 14:19:35 user nova-compute[75326]:   <devices>
Dec 06 14:19:35 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:19:35 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:19:35 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk"/>
Dec 06 14:19:35 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:19:35 user nova-compute[75326]:     </disk>
Dec 06 14:19:35 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:19:35 user nova-compute[75326]:       <mac address="fa:16:3e:5f:25:28"/>
Dec 06 14:19:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:19:35 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:19:35 user nova-compute[75326]:       <target dev="tap244649c3-bb"/>
Dec 06 14:19:35 user nova-compute[75326]:     </interface>
Dec 06 14:19:35 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:19:35 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/console.log" append="off"/>
Dec 06 14:19:35 user nova-compute[75326]:     </serial>
Dec 06 14:19:35 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:19:35 user nova-compute[75326]:     <video>
Dec 06 14:19:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:19:35 user nova-compute[75326]:     </video>
Dec 06 14:19:35 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:19:35 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:19:35 user nova-compute[75326]:     </rng>
Dec 06 14:19:35 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:19:35 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:19:35 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:19:35 user nova-compute[75326]:     </memballoon>
Dec 06 14:19:35 user nova-compute[75326]:   </devices>
Dec 06 14:19:35 user nova-compute[75326]: </domain>
Dec 06 14:19:35 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671987779',display_name='tempest-VolumesActionsTest-instance-671987779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671987779',id=29,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-rkcs1360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:19:33Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=9ff062df-5a61-4b89-8547-b668913bf4b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG os_vif [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c006179-826d-555a-9e95-0dc889eb0e7b', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap244649c3-bb, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap244649c3-bb, col_values=(('qos', UUID('59d0b411-21ef-4258-9617-aa998bd3823d')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap244649c3-bb, col_values=(('external_ids', {'iface-id': '244649c3-bbeb-42cc-bd9f-a8a94bfc27d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:25:28', 'vm-uuid': '9ff062df-5a61-4b89-8547-b668913bf4b8'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:35 user nova-compute[75326]: INFO os_vif [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb')
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] No VIF found with MAC fa:16:3e:5f:25:28, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23564666262366335', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564666262366335', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Updated VIF entry in instance network info cache for port 244649c3-bbeb-42cc-bd9f-a8a94bfc27d1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Updating instance_info_cache with network_info: [{"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3560de2-80b1-4201-a0e9-91d8abde6b80 req-1f837ecf-81bc-44bb-aed1-4778b71adebc service nova] Releasing lock "refresh_cache-9ff062df-5a61-4b89-8547-b668913bf4b8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:19:35 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:35 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:19:35 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:35 user nova-compute[75326]:   <serial>a75e1ea4-3d88-480d-97e1-f31a4be1395d</serial>
Dec 06 14:19:35 user nova-compute[75326]: </disk>
Dec 06 14:19:35 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No VIF found with MAC fa:16:3e:41:34:dc, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-45211047-7386-4276-9a1f-4f75fef4b892 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.080s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] No waiting events found dispatching network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:19:39 user nova-compute[75326]: WARNING nova.compute.manager [req-b3b4b84a-549b-4dba-92ac-bbb7913ea511 req-094ff14c-f190-46e8-ab18-b4714b7a2525 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received unexpected event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 for instance with vm_state building and task_state spawning.
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] No waiting events found dispatching network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:19:39 user nova-compute[75326]: WARNING nova.compute.manager [req-f53caa35-d4cc-4704-bfd2-3aed2c404aa5 req-4e1063fd-d216-45a5-be12-0328c79f1ac9 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received unexpected event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 for instance with vm_state building and task_state spawning.
Dec 06 14:19:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.326335906982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Instance spawned successfully.
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance fcd18b74-f5a2-4782-8a8f-bc9012497546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance aae09742-d2f6-4291-bd41-0337df3ce9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 9ff062df-5a61-4b89-8547-b668913bf4b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:19:39 user nova-compute[75326]: INFO nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Took 6.43 seconds to spawn the instance on the hypervisor.
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:19:39 user nova-compute[75326]: INFO nova.compute.manager [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Took 7.20 seconds to build instance.
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-77594502-daa5-493e-aaeb-b522fd8d8e41 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.318s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:19:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:40 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:40 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:40 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665c276-2b8d-4061-832f-24912248d41d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:40 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ecdcaf-1146-4c2d-bab4-8172374339ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e] added
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284a6ae-d277-462c-bffc-629e2e63da6f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a999bd4-17e5-4291-af51-9f501013b152]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njxZRtwr {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njxZRtwr" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce760224-846b-4fc1-b51c-0c198e5a853e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njxZRtwr'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bfdabd-a9e8-4743-a3da-0a590bc51abe]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec191d9c-717d-4b50-b10c-f07f9b21a9a6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd85253-f033-4a97-b3b0-c036d595c7a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]
Dec 06 14:19:40 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8574308-da90-4af9-91ab-672c760224a2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7261e-35f8-46c3-b87a-9e033efc53ee]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:40 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:40 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ebc9b0-84e8-452d-8f96-78897f6c2b63]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:40 user nova-compute[75326]: INFO nova.compute.manager [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attaching volume 7e6056e1-a183-47af-a443-99d799bc509c to /dev/vdc
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.utils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6120f048-5aad-47a3-b411-d174db670b34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b79059-f2f0-4b4e-9e7c-7f0aeb1e95e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a63712-f379-48c6-bc41-75c1714b2a07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c5c21-9726-49cc-b9b0-4aae708ba0a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:19:40 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:19:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19213b-5390-47a2-9919-a5a2819ed27c]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG os_brick.utils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:40 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating existing volume attachment record: 8b29c81d-f8a0-4214-858f-140da10de532 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23238313438376537', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238313438376537', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:19:41 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:41 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:19:41 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:41 user nova-compute[75326]:   <serial>5382d6ae-49b4-41be-978a-7eee414e5d0e</serial>
Dec 06 14:19:41 user nova-compute[75326]: </disk>
Dec 06 14:19:41 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No VIF found with MAC fa:16:3e:97:ea:aa, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:42 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 is timed out.
Dec 06 14:19:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully detached device vdb from instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 from the live domain config.
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b717670-38e0-4a62-95af-1aad336fc93b tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.551s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEULHibl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34888a-a1e3-4bef-a53a-8ce423d83042]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:19:42 user nova-compute[75326]: No targets found.
Dec 06 14:19:42 user nova-compute[75326]: iSNS:
Dec 06 14:19:42 user nova-compute[75326]: No targets found.
Dec 06 14:19:42 user nova-compute[75326]: STATIC:
Dec 06 14:19:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d
Dec 06 14:19:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2
Dec 06 14:19:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674
Dec 06 14:19:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:19:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:42 user nova-compute[75326]: FIRMWARE:
Dec 06 14:19:42 user nova-compute[75326]: No targets found.
Dec 06 14:19:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:19:42 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:19:42 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afd8f45-2e97-4b5b-85bd-0b1de32a6fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b39fdc-a387-4e5a-825a-da3eb96b0409]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:42 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bdb9063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74901ef-2893-4536-9091-b461c9a7f016]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32cc0f-0a81-4f10-9958-d7f4fb002a8e]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7fe807-2f38-49e6-ad86-1b59652675be]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[52da1ab0-789c-48ec-9e20-9de119513ed4]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1733ed47-886c-41c8-992e-69057914f233]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a134ee-772f-4988-b2aa-f6f4c46c193b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260]
Dec 06 14:19:42 user nova-compute[75326]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867fa5c-8a5b-4692-91db-26de0e1ee6d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e4d59-6803-44ad-a9e6-a01e3af58535]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== disconnect_volume: return (377ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG nova.objects.instance [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af63962e-8fe1-41ef-b2b5-398055b5ae49 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 is timed out.
Dec 06 14:19:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully detached device vdb from instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 from the live domain config.
Dec 06 14:19:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbLaPkfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:43 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69626bfb-24b1-486c-aebc-8939082e88be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:19:43 user nova-compute[75326]: No targets found.
Dec 06 14:19:43 user nova-compute[75326]: iSNS:
Dec 06 14:19:43 user nova-compute[75326]: No targets found.
Dec 06 14:19:43 user nova-compute[75326]: STATIC:
Dec 06 14:19:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d
Dec 06 14:19:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674
Dec 06 14:19:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:19:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:43 user nova-compute[75326]: FIRMWARE:
Dec 06 14:19:43 user nova-compute[75326]: No targets found.
Dec 06 14:19:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:19:43 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:19:43 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47e38e-c759-42c4-b1d5-499c749ec1d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f4b64-69ae-4d74-8db8-c90b2e9c81f1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:43 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:43 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 (non-flash)
Dec 06 14:19:43 user nova-compute[75326]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:43 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd43d03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d45c2-ed95-47ca-8f17-45bd97b76113]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f4413-3ed5-401c-9d79-2c553e33497a]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4586171-6ed5-4e2e-b6a9-1c61133c1173]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb755e-898a-4905-bcd6-466e0a2853c1]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:19:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[819090db-eaa9-4366-8a44-a0c4f1c15d52]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3f0e7-ad3c-44fe-b43e-e55bd6884128]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260]
Dec 06 14:19:44 user nova-compute[75326]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a56412-f3af-44fa-8455-65eb84bad674 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad3448-3d50-4b93-a497-bb181ca9f685]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] <== disconnect_volume: return (365ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:19:44 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'flavor' on Instance uuid bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c8ede552-3558-4c2b-bb16-144bb077f0ad tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing instance network info cache due to event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updated VIF entry in instance network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0bf5f583-486f-4a03-a0c0-c415b653f2a9 req-89fd5ed7-b307-4c89-a782-83447da9851f service nova] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdAZTeHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:51 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:51 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:51 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f895ea-1d86-48a8-af39-c5024d71c693]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:51 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ecd22-8b14-49e5-9249-8dd2ca0a7c0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c] added
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3b23f-4ee4-4686-bc8a-ae415fafc5bb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc687a-c334-48bf-be88-82a59a7cbcc3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdAZTeHF {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdAZTeHF" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f09bf0-9fc9-44f4-8644-0dae33dd8b0e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdAZTeHF'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[62021fa2-c456-4cf7-8432-5837aab03dd8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001f478-1853-424f-9e49-349880946ef8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92371696-7df7-497d-960e-675537fb8ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260]
Dec 06 14:19:51 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c312152b-cfd4-4a6f-9028-3c394f0e5e6a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa4745-4920-4cba-9439-2602142e79d5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:51 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7469b94f-eb20-4c53-a789-1331a207db5d]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:19:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdAZTeHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing instance network info cache due to event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23030626338313338', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030626338313338', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:19:52 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:52 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:19:52 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:19:52 user nova-compute[75326]:   <serial>7e6056e1-a183-47af-a443-99d799bc509c</serial>
Dec 06 14:19:52 user nova-compute[75326]: </disk>
Dec 06 14:19:52 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updated VIF entry in instance network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6b082a13-1425-43ba-bc90-7e6f1ef5c17a req-447578e2-3895-49c9-9fea-00b226987df0 service nova] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] No VIF found with MAC fa:16:3e:41:34:dc, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6738466b-90a1-461d-810f-724458387b76 tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.691s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:54 user nova-compute[75326]: INFO nova.compute.manager [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Detaching volume a75e1ea4-3d88-480d-97e1-f31a4be1395d
Dec 06 14:19:54 user nova-compute[75326]: INFO nova.virt.block_device [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attempting to driver detach volume a75e1ea4-3d88-480d-97e1-f31a4be1395d from mountpoint /dev/vdb
Dec 06 14:19:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Attempting to detach device vdb from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:19:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:54 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:54 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:19:54 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:54 user nova-compute[75326]:   <serial>a75e1ea4-3d88-480d-97e1-f31a4be1395d</serial>
Dec 06 14:19:54 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:54 user nova-compute[75326]: </disk>
Dec 06 14:19:54 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdb from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the persistent domain config.
Dec 06 14:19:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:19:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:19:54 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:19:54 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:19:54 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:19:54 user nova-compute[75326]:   <serial>a75e1ea4-3d88-480d-97e1-f31a4be1395d</serial>
Dec 06 14:19:54 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:19:54 user nova-compute[75326]: </disk>
Dec 06 14:19:54 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:19:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:19:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:57 user nova-compute[75326]: INFO nova.compute.manager [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Rebooting instance
Dec 06 14:19:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:19:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:19:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:19:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:19:58 user nova-compute[75326]: WARNING nova.compute.manager [req-75ae7c33-144f-45af-b308-af2dc2992104 req-41300180-71c5-464a-ac1f-fef251af7b53 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state active and task_state reboot_started_hard.
Dec 06 14:19:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance destroyed successfully.
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'resources' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:19:58Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef51fec1-2b, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ade4371b-d360-41af-b269-b152776c5879) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:19:59 user nova-compute[75326]: INFO os_vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b')
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:59 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46fbb0-98d3-47e6-ba3c-553fbf639c32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:19:59 user nova-compute[75326]: No targets found.
Dec 06 14:19:59 user nova-compute[75326]: iSNS:
Dec 06 14:19:59 user nova-compute[75326]: No targets found.
Dec 06 14:19:59 user nova-compute[75326]: STATIC:
Dec 06 14:19:59 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d
Dec 06 14:19:59 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:59 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:59 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c
Dec 06 14:19:59 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:59 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:59 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:19:59 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:19:59 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:19:59 user nova-compute[75326]: FIRMWARE:
Dec 06 14:19:59 user nova-compute[75326]: No targets found.
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:19:59 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:19:59 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc0bee1-63b4-4553-a3a9-ff65f55a6645]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3879e9d-55c5-48dc-9f47-39a9b2baf568]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5003e06-e21a-4be8-a88c-0514b30088af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cc0b1-a4a1-4e05-9210-b40ea8ae6370]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c14c9-f6cc-44dd-9d30-c25f0e65319f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4337034-815b-4281-b3c7-51693adaffd1]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[092534df-d39e-4a20-9e59-12c150eb6380]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf88fc-03a9-4c21-ac3d-3e926d85cd1b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]
Dec 06 14:19:59 user nova-compute[75326]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2887245e-a2de-4cf1-8d28-19ee4d6ba984]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== disconnect_volume: return (280ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start _get_guest_xml network_info=[{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=888a41b0-1feb-4344-b96d-971dc84333e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '888a41b0-1feb-4344-b96d-971dc84333e3'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ddfb0a6b-5835-4d32-9897-db4adde06706', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7626a81f-f1bc-4aef-be81-b5979fc9bbcb', 'attached_at': '', 'detached_at': '', 'volume_id': '5382d6ae-49b4-41be-978a-7eee414e5d0e', 'serial': '5382d6ae-49b4-41be-978a-7eee414e5d0e'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:19:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=888a41b0-1feb-4344-b96d-971dc84333e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.objects.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Object Instance<7626a81f-f1bc-4aef-be81-b5979fc9bbcb> lazy-loaded attributes: resources,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:19:59 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:59 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:19:59 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4262df84-92cb-47e0-981c-c01509ace50e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:19:59 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6399204d-d79b-4c83-a2d5-12654d38a603]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e] added
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b76cc6-bb81-4df4-9bfd-e974d5e0b765]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2a235-33d3-4eac-84bb-eadc4745c99c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njxZRtwr {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njxZRtwr" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bde4a6-e0d3-48c7-93b9-e2914ee73386]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njxZRtwr'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2eebbc-7b8b-4ef2-a821-f883510b3a17]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe485b0-4fc5-4f15-9997-784d936c289f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fdabd0-217d-427e-8b5c-4ec9d9ce506b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]
Dec 06 14:19:59 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525b380-6eeb-47ed-a94d-a0c82ce1ee1c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f87516-b38f-49d9-89d5-dcce74fc837d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:19:59 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:19:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ca867-8c2d-418d-9b0b-c5b94ce38358]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:19:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:00 user nova-compute[75326]: WARNING nova.compute.manager [req-225a2db9-ae96-4be8-ac74-515bdaa9a649 req-389fdfec-bcee-4246-8fd0-076a02fd14e2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state active and task_state reboot_started_hard.
Dec 06 14:20:00 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23238313438376537', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238313438376537', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:19:58Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'pci_devices' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.objects.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Object Instance<7626a81f-f1bc-4aef-be81-b5979fc9bbcb> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:20:00 user nova-compute[75326]:   <uuid>7626a81f-f1bc-4aef-be81-b5979fc9bbcb</uuid>
Dec 06 14:20:00 user nova-compute[75326]:   <name>instance-0000001b</name>
Dec 06 14:20:00 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:20:00 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:20:00 user nova-compute[75326]:   <metadata>
Dec 06 14:20:00 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:20:00 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:name>tempest-TestMinimumBasicScenario-server-843579329</nova:name>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:19:59</nova:creationTime>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:20:00 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:20:00 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:owner>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:user uuid="c053c2d147df4c959d5cffa31dc2490c">tempest-TestMinimumBasicScenario-1988051507-project-member</nova:user>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:project uuid="44e022afe38348fd87bc8b16175e1f09">tempest-TestMinimumBasicScenario-1988051507</nova:project>
Dec 06 14:20:00 user nova-compute[75326]:       </nova:owner>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:root type="image" uuid="888a41b0-1feb-4344-b96d-971dc84333e3"/>
Dec 06 14:20:00 user nova-compute[75326]:       <nova:ports>
Dec 06 14:20:00 user nova-compute[75326]:         <nova:port uuid="ef51fec1-2bd2-4742-bbb6-8c54c05e06bd">
Dec 06 14:20:00 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 14:20:00 user nova-compute[75326]:         </nova:port>
Dec 06 14:20:00 user nova-compute[75326]:       </nova:ports>
Dec 06 14:20:00 user nova-compute[75326]:     </nova:instance>
Dec 06 14:20:00 user nova-compute[75326]:   </metadata>
Dec 06 14:20:00 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:20:00 user nova-compute[75326]:     <system>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="serial">7626a81f-f1bc-4aef-be81-b5979fc9bbcb</entry>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="uuid">7626a81f-f1bc-4aef-be81-b5979fc9bbcb</entry>
Dec 06 14:20:00 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:20:00 user nova-compute[75326]:     </system>
Dec 06 14:20:00 user nova-compute[75326]:   </sysinfo>
Dec 06 14:20:00 user nova-compute[75326]:   <os>
Dec 06 14:20:00 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:20:00 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:20:00 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:20:00 user nova-compute[75326]:   </os>
Dec 06 14:20:00 user nova-compute[75326]:   <features>
Dec 06 14:20:00 user nova-compute[75326]:     <acpi/>
Dec 06 14:20:00 user nova-compute[75326]:     <apic/>
Dec 06 14:20:00 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:20:00 user nova-compute[75326]:   </features>
Dec 06 14:20:00 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:20:00 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:20:00 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:20:00 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:20:00 user nova-compute[75326]:   </clock>
Dec 06 14:20:00 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:20:00 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:20:00 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:20:00 user nova-compute[75326]:   </cpu>
Dec 06 14:20:00 user nova-compute[75326]:   <devices>
Dec 06 14:20:00 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:00 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:00 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk"/>
Dec 06 14:20:00 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:20:00 user nova-compute[75326]:     </disk>
Dec 06 14:20:00 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:20:00 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:20:00 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:20:00 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:20:00 user nova-compute[75326]:       <serial>5382d6ae-49b4-41be-978a-7eee414e5d0e</serial>
Dec 06 14:20:00 user nova-compute[75326]:     </disk>
Dec 06 14:20:00 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:20:00 user nova-compute[75326]:       <mac address="fa:16:3e:97:ea:aa"/>
Dec 06 14:20:00 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:00 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:20:00 user nova-compute[75326]:       <target dev="tapef51fec1-2b"/>
Dec 06 14:20:00 user nova-compute[75326]:     </interface>
Dec 06 14:20:00 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:20:00 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/console.log" append="off"/>
Dec 06 14:20:00 user nova-compute[75326]:     </serial>
Dec 06 14:20:00 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:20:00 user nova-compute[75326]:     <video>
Dec 06 14:20:00 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:00 user nova-compute[75326]:     </video>
Dec 06 14:20:00 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:20:00 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:20:00 user nova-compute[75326]:     </rng>
Dec 06 14:20:00 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:20:00 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:20:00 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:20:00 user nova-compute[75326]:     </memballoon>
Dec 06 14:20:00 user nova-compute[75326]:   </devices>
Dec 06 14:20:00 user nova-compute[75326]: </domain>
Dec 06 14:20:00 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.objects.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Object Instance<7626a81f-f1bc-4aef-be81-b5979fc9bbcb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Cannot resize image /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'migration_context' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.objects.base [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Object Instance<7626a81f-f1bc-4aef-be81-b5979fc9bbcb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:19:58Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG os_vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a71684c9-b375-57f3-ac5c-1e3b8327b29b', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef51fec1-2b, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef51fec1-2b, col_values=(('qos', UUID('49dc8d7b-5f4f-46a3-b0b7-859c266bd9ee')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef51fec1-2b, col_values=(('external_ids', {'iface-id': 'ef51fec1-2bd2-4742-bbb6-8c54c05e06bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:ea:aa', 'vm-uuid': '7626a81f-f1bc-4aef-be81-b5979fc9bbcb'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:01 user nova-compute[75326]: INFO os_vif [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b')
Dec 06 14:20:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:03 user nova-compute[75326]: WARNING nova.compute.manager [req-afb7ea3c-f640-47c5-8ca7-858f9b6f7b43 req-1d8a6b97-835c-49e6-88c4-77513d71c3d2 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state active and task_state reboot_started_hard.
Dec 06 14:20:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:20:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance rebooted successfully.
Dec 06 14:20:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:05 user nova-compute[75326]: WARNING nova.compute.manager [req-b45b467b-0104-43dd-a181-17dc11af47d2 req-f8abb4de-bfd0-4ae8-aeb3-75ab9e8b6de5 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state active and task_state reboot_started_hard.
Dec 06 14:20:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-44887daf-dc18-49c8-a4f9-9090248e058f tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.582s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:13 user nova-compute[75326]: INFO nova.compute.manager [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Terminating instance
Dec 06 14:20:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-unplugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] No waiting events found dispatching network-vif-unplugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-814f35c7-0e0e-4186-ab27-85d3ec3db783 req-7925caff-25d6-4897-8024-c341fe631d63 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-unplugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:20:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Instance destroyed successfully.
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lazy-loading 'resources' on Instance uuid bb123c3e-1a86-4051-bf1d-70ed6d7c6f50 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-811489441',display_name='tempest-AttachVolumeNegativeTest-server-811489441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-811489441',id=25,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnGe+E8hNSJLMxTa/lSPNCv82sqyYQOhdLSSn+MksDur2qlroWZkDgAK0m/VU2NHrD4ZbKo5WTVGeDTr/KTZhI2RWDjiksdyE0qylDb1jCS87s8qia6ct9wvNGij/LUCA==',key_name='tempest-keypair-1825592576',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56d8164e56e499c90eca8cb27e98bf9',ramdisk_id='',reservation_id='r-65y0w7c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1014509330',owner_user_name='tempest-AttachVolumeNegativeTest-1014509330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ea783d27940479b9d78a93500062e8e',uuid=bb123c3e-1a86-4051-bf1d-70ed6d7c6f50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converting VIF {"id": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "address": "fa:16:3e:69:1f:6d", "network": {"id": "8290aa75-c470-48e4-a35c-7581187f77ef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-140868120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56d8164e56e499c90eca8cb27e98bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb31cc4-82", "ovs_interfaceid": "ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_vif [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb31cc4-82, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac6c9284-d077-4874-8cc0-832b7f0725bd) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:14 user nova-compute[75326]: INFO os_vif [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:1f:6d,bridge_name='br-int',has_traffic_filtering=True,id=ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86,network=Network(8290aa75-c470-48e4-a35c-7581187f77ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb31cc4-82')
Dec 06 14:20:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Deleting instance files /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50_del
Dec 06 14:20:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Deletion of /opt/stack/data/nova/instances/bb123c3e-1a86-4051-bf1d-70ed6d7c6f50_del complete
Dec 06 14:20:14 user nova-compute[75326]: INFO nova.compute.manager [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:20:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 is timed out.
Dec 06 14:20:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdb from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the live domain config.
Dec 06 14:20:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvmRdAzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:20:14 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[88878243-c3d8-4992-a893-3490d7bd9dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:20:14 user nova-compute[75326]: No targets found.
Dec 06 14:20:14 user nova-compute[75326]: iSNS:
Dec 06 14:20:14 user nova-compute[75326]: No targets found.
Dec 06 14:20:14 user nova-compute[75326]: STATIC:
Dec 06 14:20:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d
Dec 06 14:20:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c
Dec 06 14:20:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:20:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:14 user nova-compute[75326]: FIRMWARE:
Dec 06 14:20:14 user nova-compute[75326]: No targets found.
Dec 06 14:20:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:20:14 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:20:14 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56ae15-8344-402a-9a73-3aa588c0f9ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[699f5c44-2307-4558-a618-effeb88e70a9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:20:14 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:14 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d (non-flash)
Dec 06 14:20:14 user nova-compute[75326]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:14 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43e0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea0869-1a7f-45bc-b7b5-652648259523]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[503db121-f6aa-446a-8188-32f546a5a986]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[610bf7ae-fb1d-473e-b373-360094c53d77]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c3070-3fac-4ca3-8917-f770ff2a70c8]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[97564776-e34a-4af0-ac06-93c0bdc701b2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c200feb-318a-4e41-9b1e-ff1cbbcbabbe]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260]
Dec 06 14:20:15 user nova-compute[75326]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d, portal: 172.16.0.220,3260] successful.
Dec 06 14:20:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75e1ea4-3d88-480d-97e1-f31a4be1395d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1c382-3e91-465f-932b-630314c16da6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== disconnect_volume: return (338ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:15 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Took 1.00 seconds to deallocate network for instance.
Dec 06 14:20:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-7995c01b-9ff1-4b0f-afd3-5a5452a86e1d req-48abdba4-9514-4170-95ff-5ddd66c863f1 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-deleted-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:15 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Deleted allocations for instance bb123c3e-1a86-4051-bf1d-70ed6d7c6f50
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4eaed6f9-4ee1-4886-82ad-4bc0884ddc40 tempest-AttachVolumeNegativeTest-1014509330 tempest-AttachVolumeNegativeTest-1014509330-project-member] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.534s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b5819857-ff8e-47f8-b188-662e9770215b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.084s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] Acquiring lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] Lock "bb123c3e-1a86-4051-bf1d-70ed6d7c6f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] No waiting events found dispatching network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:16 user nova-compute[75326]: WARNING nova.compute.manager [req-2e91b995-7fdd-4832-a32f-cc6d29d5104d req-87f486cf-9235-4fbc-9832-33976a1939c1 service nova] [instance: bb123c3e-1a86-4051-bf1d-70ed6d7c6f50] Received unexpected event network-vif-plugged-ebb31cc4-82bb-4bb1-93f5-7c58c70f3b86 for instance with vm_state deleted and task_state None.
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:16 user nova-compute[75326]: INFO nova.compute.manager [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Detaching volume 7e6056e1-a183-47af-a443-99d799bc509c
Dec 06 14:20:17 user nova-compute[75326]: INFO nova.virt.block_device [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Attempting to driver detach volume 7e6056e1-a183-47af-a443-99d799bc509c from mountpoint /dev/vdc
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Attempting to detach device vdc from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:20:17 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:20:17 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:20:17 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:20:17 user nova-compute[75326]:   <serial>7e6056e1-a183-47af-a443-99d799bc509c</serial>
Dec 06 14:20:17 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:20:17 user nova-compute[75326]: </disk>
Dec 06 14:20:17 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:20:17 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdc from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the persistent domain config.
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:20:17 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:20:17 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:20:17 user nova-compute[75326]:   <target dev="vdc" bus="virtio"/>
Dec 06 14:20:17 user nova-compute[75326]:   <serial>7e6056e1-a183-47af-a443-99d799bc509c</serial>
Dec 06 14:20:17 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 14:20:17 user nova-compute[75326]: </disk>
Dec 06 14:20:17 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:20:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:17 user nova-compute[75326]: INFO nova.compute.manager [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] instance snapshotting
Dec 06 14:20:18 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Beginning live snapshot process
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing instance network info cache due to event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0.delta 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0.delta 1073741824" returned: 0 in 0.057s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:18 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 14:20:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updated VIF entry in instance network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:20:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-318e1d63-9adb-4f85-8a5a-14a6359469e8 req-c8167388-9ae6-4178-8789-cea42f07ea24 service nova] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:20:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 14:20:20 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0.delta /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0.delta /opt/stack/data/nova/instances/snapshots/tmpcq6ljfrk/5d9d8ac2930e4fd89581534be2f224a0" returned: 0 in 0.356s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Snapshot extracted, beginning image upload
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:20 user nova-compute[75326]: INFO nova.compute.manager [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Shelving
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.compute.claims [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Claim successful on node user
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:21 user nova-compute[75326]: WARNING nova.compute.manager [req-9b354703-161e-4787-b023-921340f0bfa3 req-570ccd17-43fa-46a3-8c2b-a04437fb30cd service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving.
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'flavor' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance destroyed successfully.
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:20:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Beginning cold snapshot process
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.policy [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '779267c6564b43c293a1025a9c575b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cdbc282e0a4495b38e0383600b8363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.compute.manager [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attaching volume eeb03607-4902-46f7-8a27-420222cbbefd to /dev/vdb
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:20:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Creating image(s)
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk /opt/stack/data/nova/instances/snapshots/tmpuoxj774e/67a067c237194b27a12cefc6d8bf73df {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG os_brick.utils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:20:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[86710db8-1258-4699-97d5-ffccf69d368f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e545f-d588-4f7b-b916-5c17c3a87255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ff8da-3ef8-4a08-b55e-6e303c0efc34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c998976a-353e-4089-a44d-77c1d0857c5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.242s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:20:22 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53efcf1-4f8a-4ba1-8987-999548c7914c]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG os_brick.utils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] <== get_connector_properties: return (435ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating existing volume attachment record: 41cadf1f-3a90-481f-baad-e28b7c7e1f03 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk 1073741824" returned: 0 in 0.101s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Cannot resize image /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Ensure instance console log exists: /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk /opt/stack/data/nova/instances/snapshots/tmpuoxj774e/67a067c237194b27a12cefc6d8bf73df" returned: 0 in 1.063s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Snapshot extracted, beginning image upload
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:23 user nova-compute[75326]: WARNING nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:23 user nova-compute[75326]: WARNING nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:23 user nova-compute[75326]: WARNING nova.compute.manager [req-cdb6bf28-0546-414f-afb1-c8d6792bcd54 req-eb0dcbd9-6563-44c8-b4b2-ccc6a1fd7f66 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:20:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Successfully created port: bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:20:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Snapshot image upload complete
Dec 06 14:20:23 user nova-compute[75326]: INFO nova.compute.manager [None req-8d853e1d-1afc-4baa-bbb8-9b91b000e606 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Took 5.96 seconds to snapshot the instance on the hypervisor.
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Successfully updated port: bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance network_info: |[{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start _get_guest_xml network_info=[{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:20:24 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:24 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-179122323',display_name='tempest-ServerRescueNegativeTestJSON-server-179122323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-179122323',id=30,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDo4KtQFM7EcVVHt7y/hycZVjZUXQlwTsbBRR7uN2iZEHpsd8nONHCpP6FlDhIZnE9umGWZdGhAgSmo2hmSWtXZ3C+aD4PJwQzZZfdqqGLLYWElfJjHkya3UCo2nUVktLg==',key_name='tempest-keypair-1954013525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-hwfmt608',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='779267c6564b43c293a1025a9c575b13',uuid=90182363-4e9a-47be-93da-9dc41de98d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:20:24 user nova-compute[75326]:   <uuid>90182363-4e9a-47be-93da-9dc41de98d4d</uuid>
Dec 06 14:20:24 user nova-compute[75326]:   <name>instance-0000001e</name>
Dec 06 14:20:24 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:20:24 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:20:24 user nova-compute[75326]:   <metadata>
Dec 06 14:20:24 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:20:24 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-179122323</nova:name>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:20:24</nova:creationTime>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:20:24 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:20:24 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:owner>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:20:24 user nova-compute[75326]:       </nova:owner>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:20:24 user nova-compute[75326]:       <nova:ports>
Dec 06 14:20:24 user nova-compute[75326]:         <nova:port uuid="bfaffc42-371b-4ebb-8216-65f90d996612">
Dec 06 14:20:24 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:20:24 user nova-compute[75326]:         </nova:port>
Dec 06 14:20:24 user nova-compute[75326]:       </nova:ports>
Dec 06 14:20:24 user nova-compute[75326]:     </nova:instance>
Dec 06 14:20:24 user nova-compute[75326]:   </metadata>
Dec 06 14:20:24 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:20:24 user nova-compute[75326]:     <system>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="serial">90182363-4e9a-47be-93da-9dc41de98d4d</entry>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="uuid">90182363-4e9a-47be-93da-9dc41de98d4d</entry>
Dec 06 14:20:24 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:20:24 user nova-compute[75326]:     </system>
Dec 06 14:20:24 user nova-compute[75326]:   </sysinfo>
Dec 06 14:20:24 user nova-compute[75326]:   <os>
Dec 06 14:20:24 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:20:24 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:20:24 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:20:24 user nova-compute[75326]:   </os>
Dec 06 14:20:24 user nova-compute[75326]:   <features>
Dec 06 14:20:24 user nova-compute[75326]:     <acpi/>
Dec 06 14:20:24 user nova-compute[75326]:     <apic/>
Dec 06 14:20:24 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:20:24 user nova-compute[75326]:   </features>
Dec 06 14:20:24 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:20:24 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:20:24 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:20:24 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:20:24 user nova-compute[75326]:   </clock>
Dec 06 14:20:24 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:20:24 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:20:24 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:20:24 user nova-compute[75326]:   </cpu>
Dec 06 14:20:24 user nova-compute[75326]:   <devices>
Dec 06 14:20:24 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:24 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:24 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk"/>
Dec 06 14:20:24 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:20:24 user nova-compute[75326]:     </disk>
Dec 06 14:20:24 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:20:24 user nova-compute[75326]:       <mac address="fa:16:3e:bc:0c:f6"/>
Dec 06 14:20:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:24 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:20:24 user nova-compute[75326]:       <target dev="tapbfaffc42-37"/>
Dec 06 14:20:24 user nova-compute[75326]:     </interface>
Dec 06 14:20:24 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:20:24 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/console.log" append="off"/>
Dec 06 14:20:24 user nova-compute[75326]:     </serial>
Dec 06 14:20:24 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:20:24 user nova-compute[75326]:     <video>
Dec 06 14:20:24 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:24 user nova-compute[75326]:     </video>
Dec 06 14:20:24 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:20:24 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:20:24 user nova-compute[75326]:     </rng>
Dec 06 14:20:24 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:20:24 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:20:24 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:20:24 user nova-compute[75326]:     </memballoon>
Dec 06 14:20:24 user nova-compute[75326]:   </devices>
Dec 06 14:20:24 user nova-compute[75326]: </domain>
Dec 06 14:20:24 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-179122323',display_name='tempest-ServerRescueNegativeTestJSON-server-179122323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-179122323',id=30,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDo4KtQFM7EcVVHt7y/hycZVjZUXQlwTsbBRR7uN2iZEHpsd8nONHCpP6FlDhIZnE9umGWZdGhAgSmo2hmSWtXZ3C+aD4PJwQzZZfdqqGLLYWElfJjHkya3UCo2nUVktLg==',key_name='tempest-keypair-1954013525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-hwfmt608',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='779267c6564b43c293a1025a9c575b13',uuid=90182363-4e9a-47be-93da-9dc41de98d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG os_vif [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad42e413-23af-583e-9b9f-ba989433c49e', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfaffc42-37, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfaffc42-37, col_values=(('qos', UUID('f2b9b935-136d-4fc2-af75-1eb679e390b6')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfaffc42-37, col_values=(('external_ids', {'iface-id': 'bfaffc42-371b-4ebb-8216-65f90d996612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:0c:f6', 'vm-uuid': '90182363-4e9a-47be-93da-9dc41de98d4d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:24 user nova-compute[75326]: INFO os_vif [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37')
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:bc:0c:f6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:25 user nova-compute[75326]: WARNING nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:25 user nova-compute[75326]: WARNING nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing instance network info cache due to event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:20:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Snapshot image upload complete
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:25 user nova-compute[75326]: INFO nova.compute.manager [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Shelve offloading
Dec 06 14:20:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance destroyed successfully.
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updated VIF entry in instance network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5590ff15-5948-4aee-a0ef-a2bfe30d3113 req-101ce08c-72cd-4fe5-8803-89fe1b163fdb service nova] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG nova.network.neutron [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:20:26 user nova-compute[75326]: INFO nova.compute.claims [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Claim successful on node user
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:27 user nova-compute[75326]: WARNING nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state building and task_state spawning.
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:27 user nova-compute[75326]: WARNING nova.compute.manager [req-5cf00e65-2df1-4bd5-b090-cf533a861f24 req-09be1b4b-0eda-4787-b87c-d5067920faea service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state building and task_state spawning.
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance destroyed successfully.
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.objects.instance [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'resources' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvA7c2M/dNfeZX/7DVkmjUtVFHsXll6qoNszwh/Ws48lSDFoMCbAYmQB78PXMLbrZ4Xf86khlAvf5S9iUTkCJs6lcoOi2Gx0DD9s8NwwDYYoCUrKTCpmCWIvaQGzlMXiA==',key_name='tempest-keypair-606551783',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:18:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:20:25.712371',shelved_host='user',shelved_image_id='57b59df1-bf27-4266-9c3d-fb4b1e25a04a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG os_vif [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5ea5d62-60, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing instance network info cache due to event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9d07a8a-b513-49cd-a2f5-20b93580bb26) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:27 user nova-compute[75326]: INFO os_vif [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60')
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Deleting instance files /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1_del
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Deletion of /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1_del complete
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Deleted allocations for instance aae09742-d2f6-4291-bd41-0337df3ce9c1
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.objects.instance [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'numa_topology' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.objects.base [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<aae09742-d2f6-4291-bd41-0337df3ce9c1> lazy-loaded attributes: resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.policy [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60a9ed63f2b04f8cb9616a6394be48b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20585cba38541d88671fc0448e0c686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:20:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Creating image(s)
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "/opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "/opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "7bcececc948018195e89a8bddff8a84c36628cdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "7bcececc948018195e89a8bddff8a84c36628cdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updated VIF entry in instance network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:20:27 user nova-compute[75326]: DEBUG nova.network.neutron [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4627276b-6058-4750-a457-43ea71dfe270 req-c63e9ec7-9a2a-4c4d-af19-c34d0cf9f4d0 service nova] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Successfully created port: a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:20:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance spawned successfully.
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.814s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.virt.images [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] 6b478fb4-6ef5-4158-bd7d-3e42fd66c03e was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.part /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:29 user nova-compute[75326]: INFO nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Took 7.71 seconds to spawn the instance on the hypervisor.
Dec 06 14:20:29 user nova-compute[75326]: DEBUG nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-79dc0984-38ae-4547-b1a1-09c22440aa29 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.833s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:29 user nova-compute[75326]: INFO nova.compute.manager [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Took 8.75 seconds to build instance.
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-23fad5cd-f509-4763-8dac-25eafdf7c039 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.940s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.part /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.converted" returned: 0 in 0.455s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "7bcececc948018195e89a8bddff8a84c36628cdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.283s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Successfully updated port: a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquired lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing instance network info cache due to event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] Acquiring lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json" returned: 0 in 0.229s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "7bcececc948018195e89a8bddff8a84c36628cdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "7bcececc948018195e89a8bddff8a84c36628cdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:20:30 user nova-compute[75326]: INFO nova.compute.claims [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Claim successful on node user
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json" returned: 0 in 0.225s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb,backing_fmt=raw /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.neutron [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating instance_info_cache with network_info: [{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb,backing_fmt=raw /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk 1073741824" returned: 0 in 0.057s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "7bcececc948018195e89a8bddff8a84c36628cdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Releasing lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Instance network_info: |[{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] Acquired lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.neutron [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Ensure instance console log exists: /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Start _get_guest_xml network_info=[{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='37b1697bd9e909ab269f180cf7358d51',container_format='bare',created_at=2023-12-06T14:20:18Z,direct_url=<?>,disk_format='qcow2',id=6b478fb4-6ef5-4158-bd7d-3e42fd66c03e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1902927471',owner='c20585cba38541d88671fc0448e0c686',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T14:20:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '6b478fb4-6ef5-4158-bd7d-3e42fd66c03e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:20:30 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:30 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='37b1697bd9e909ab269f180cf7358d51',container_format='bare',created_at=2023-12-06T14:20:18Z,direct_url=<?>,disk_format='qcow2',id=6b478fb4-6ef5-4158-bd7d-3e42fd66c03e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1902927471',owner='c20585cba38541d88671fc0448e0c686',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T14:20:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1917057359',display_name='tempest-TestStampPattern-server-1917057359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1917057359',id=31,image_ref='6b478fb4-6ef5-4158-bd7d-3e42fd66c03e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-5f599j26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9',image_min_disk='1',image_min_ram='0',image_owner_id='c20585cba38541d88671fc0448e0c686',image_owner_project_name='tempest-TestStampPattern-690937075',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-690937075-project-member',image_user_id='60a9ed63f2b04f8cb9616a6394be48b9',network_allocated='True',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:28Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=d1956e9c-87a4-48b8-9413-ef2d701893a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:20:30 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'pci_devices' on Instance uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:20:31 user nova-compute[75326]:   <uuid>d1956e9c-87a4-48b8-9413-ef2d701893a0</uuid>
Dec 06 14:20:31 user nova-compute[75326]:   <name>instance-0000001f</name>
Dec 06 14:20:31 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:20:31 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:20:31 user nova-compute[75326]:   <metadata>
Dec 06 14:20:31 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:20:31 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:name>tempest-TestStampPattern-server-1917057359</nova:name>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:20:30</nova:creationTime>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:20:31 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:20:31 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:owner>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:user uuid="60a9ed63f2b04f8cb9616a6394be48b9">tempest-TestStampPattern-690937075-project-member</nova:user>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:project uuid="c20585cba38541d88671fc0448e0c686">tempest-TestStampPattern-690937075</nova:project>
Dec 06 14:20:31 user nova-compute[75326]:       </nova:owner>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:root type="image" uuid="6b478fb4-6ef5-4158-bd7d-3e42fd66c03e"/>
Dec 06 14:20:31 user nova-compute[75326]:       <nova:ports>
Dec 06 14:20:31 user nova-compute[75326]:         <nova:port uuid="a39e9b36-7082-40a8-8f1e-444c4b23ff47">
Dec 06 14:20:31 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:20:31 user nova-compute[75326]:         </nova:port>
Dec 06 14:20:31 user nova-compute[75326]:       </nova:ports>
Dec 06 14:20:31 user nova-compute[75326]:     </nova:instance>
Dec 06 14:20:31 user nova-compute[75326]:   </metadata>
Dec 06 14:20:31 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:20:31 user nova-compute[75326]:     <system>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="serial">d1956e9c-87a4-48b8-9413-ef2d701893a0</entry>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="uuid">d1956e9c-87a4-48b8-9413-ef2d701893a0</entry>
Dec 06 14:20:31 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:20:31 user nova-compute[75326]:     </system>
Dec 06 14:20:31 user nova-compute[75326]:   </sysinfo>
Dec 06 14:20:31 user nova-compute[75326]:   <os>
Dec 06 14:20:31 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:20:31 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:20:31 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:20:31 user nova-compute[75326]:   </os>
Dec 06 14:20:31 user nova-compute[75326]:   <features>
Dec 06 14:20:31 user nova-compute[75326]:     <acpi/>
Dec 06 14:20:31 user nova-compute[75326]:     <apic/>
Dec 06 14:20:31 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:20:31 user nova-compute[75326]:   </features>
Dec 06 14:20:31 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:20:31 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:20:31 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:20:31 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:20:31 user nova-compute[75326]:   </clock>
Dec 06 14:20:31 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:20:31 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:20:31 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:20:31 user nova-compute[75326]:   </cpu>
Dec 06 14:20:31 user nova-compute[75326]:   <devices>
Dec 06 14:20:31 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:31 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:31 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk"/>
Dec 06 14:20:31 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:20:31 user nova-compute[75326]:     </disk>
Dec 06 14:20:31 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:20:31 user nova-compute[75326]:       <mac address="fa:16:3e:cc:6d:9e"/>
Dec 06 14:20:31 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:31 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:20:31 user nova-compute[75326]:       <target dev="tapa39e9b36-70"/>
Dec 06 14:20:31 user nova-compute[75326]:     </interface>
Dec 06 14:20:31 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:20:31 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/console.log" append="off"/>
Dec 06 14:20:31 user nova-compute[75326]:     </serial>
Dec 06 14:20:31 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:20:31 user nova-compute[75326]:     <video>
Dec 06 14:20:31 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:31 user nova-compute[75326]:     </video>
Dec 06 14:20:31 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:20:31 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:20:31 user nova-compute[75326]:     </rng>
Dec 06 14:20:31 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:20:31 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:20:31 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:20:31 user nova-compute[75326]:     </memballoon>
Dec 06 14:20:31 user nova-compute[75326]:   </devices>
Dec 06 14:20:31 user nova-compute[75326]: </domain>
Dec 06 14:20:31 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1917057359',display_name='tempest-TestStampPattern-server-1917057359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1917057359',id=31,image_ref='6b478fb4-6ef5-4158-bd7d-3e42fd66c03e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-5f599j26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9',image_min_disk='1',image_min_ram='0',image_owner_id='c20585cba38541d88671fc0448e0c686',image_owner_project_name='tempest-TestStampPattern-690937075',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-690937075-project-member',image_user_id='60a9ed63f2b04f8cb9616a6394be48b9',network_allocated='True',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:28Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=d1956e9c-87a4-48b8-9413-ef2d701893a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG os_vif [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd202574-3776-500d-8d4b-ff9315619989', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa39e9b36-70, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa39e9b36-70, col_values=(('qos', UUID('f622cf09-811d-4ee3-a13e-771e6c94691b')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa39e9b36-70, col_values=(('external_ids', {'iface-id': 'a39e9b36-7082-40a8-8f1e-444c4b23ff47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6d:9e', 'vm-uuid': 'd1956e9c-87a4-48b8-9413-ef2d701893a0'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:31 user nova-compute[75326]: INFO os_vif [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70')
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No VIF found with MAC fa:16:3e:cc:6d:9e, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:20:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.policy [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584d6786de6449e7b07e35ca2a0a2291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea056f8f4348118fce811a5b38bbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updated VIF entry in instance network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating instance_info_cache with network_info: [{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-694ba1b8-b376-4dab-a4be-068c9c20aa6e req-bac3c311-843c-4986-98fe-06547289de6e service nova] Releasing lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:20:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Creating image(s)
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk 1073741824" returned: 0 in 0.054s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Successfully created port: c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Cannot resize image /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Ensure instance console log exists: /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] No waiting events found dispatching network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:32 user nova-compute[75326]: WARNING nova.compute.manager [req-8bbefa18-be87-4faf-987f-41e66b52315a req-e697fb01-a25c-45d3-8529-eadc2a19b31d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received unexpected event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 for instance with vm_state building and task_state spawning.
Dec 06 14:20:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Successfully updated port: c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-changed-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Refreshing instance network info cache due to event network-changed-c2a526e1-0870-43c1-8577-3359acb2102a. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] Acquiring lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating instance_info_cache with network_info: [{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance network_info: |[{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] Acquired lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Refreshing network info cache for port c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start _get_guest_xml network_info=[{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:20:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:33 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-tempest.common.compute-instance-1255368613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.objects.instance [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:20:33 user nova-compute[75326]:   <uuid>8f420a26-49d6-474d-8c32-750e9167564e</uuid>
Dec 06 14:20:33 user nova-compute[75326]:   <name>instance-00000020</name>
Dec 06 14:20:33 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:20:33 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:20:33 user nova-compute[75326]:   <metadata>
Dec 06 14:20:33 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:20:33 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:name>tempest-tempest.common.compute-instance-1255368613</nova:name>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:20:33</nova:creationTime>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:20:33 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:20:33 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:owner>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:user uuid="584d6786de6449e7b07e35ca2a0a2291">tempest-ServerActionsTestOtherA-1568176033-project-member</nova:user>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:project uuid="fcea056f8f4348118fce811a5b38bbe3">tempest-ServerActionsTestOtherA-1568176033</nova:project>
Dec 06 14:20:33 user nova-compute[75326]:       </nova:owner>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:20:33 user nova-compute[75326]:       <nova:ports>
Dec 06 14:20:33 user nova-compute[75326]:         <nova:port uuid="c2a526e1-0870-43c1-8577-3359acb2102a">
Dec 06 14:20:33 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:20:33 user nova-compute[75326]:         </nova:port>
Dec 06 14:20:33 user nova-compute[75326]:       </nova:ports>
Dec 06 14:20:33 user nova-compute[75326]:     </nova:instance>
Dec 06 14:20:33 user nova-compute[75326]:   </metadata>
Dec 06 14:20:33 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:20:33 user nova-compute[75326]:     <system>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="serial">8f420a26-49d6-474d-8c32-750e9167564e</entry>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="uuid">8f420a26-49d6-474d-8c32-750e9167564e</entry>
Dec 06 14:20:33 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:20:33 user nova-compute[75326]:     </system>
Dec 06 14:20:33 user nova-compute[75326]:   </sysinfo>
Dec 06 14:20:33 user nova-compute[75326]:   <os>
Dec 06 14:20:33 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:20:33 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:20:33 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:20:33 user nova-compute[75326]:   </os>
Dec 06 14:20:33 user nova-compute[75326]:   <features>
Dec 06 14:20:33 user nova-compute[75326]:     <acpi/>
Dec 06 14:20:33 user nova-compute[75326]:     <apic/>
Dec 06 14:20:33 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:20:33 user nova-compute[75326]:   </features>
Dec 06 14:20:33 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:20:33 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:20:33 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:20:33 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:20:33 user nova-compute[75326]:   </clock>
Dec 06 14:20:33 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:20:33 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:20:33 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:20:33 user nova-compute[75326]:   </cpu>
Dec 06 14:20:33 user nova-compute[75326]:   <devices>
Dec 06 14:20:33 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:33 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:33 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk"/>
Dec 06 14:20:33 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:20:33 user nova-compute[75326]:     </disk>
Dec 06 14:20:33 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:20:33 user nova-compute[75326]:       <mac address="fa:16:3e:06:bb:07"/>
Dec 06 14:20:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:33 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:20:33 user nova-compute[75326]:       <target dev="tapc2a526e1-08"/>
Dec 06 14:20:33 user nova-compute[75326]:     </interface>
Dec 06 14:20:33 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:20:33 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/console.log" append="off"/>
Dec 06 14:20:33 user nova-compute[75326]:     </serial>
Dec 06 14:20:33 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:20:33 user nova-compute[75326]:     <video>
Dec 06 14:20:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:33 user nova-compute[75326]:     </video>
Dec 06 14:20:33 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:20:33 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:20:33 user nova-compute[75326]:     </rng>
Dec 06 14:20:33 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:20:33 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:20:33 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:20:33 user nova-compute[75326]:     </memballoon>
Dec 06 14:20:33 user nova-compute[75326]:   </devices>
Dec 06 14:20:33 user nova-compute[75326]: </domain>
Dec 06 14:20:33 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-tempest.common.compute-instance-1255368613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_vif [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4435df09-20d5-5ea7-9bd5-49ba95b95f53', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a526e1-08, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a526e1-08, col_values=(('qos', UUID('227ac366-619b-460c-b185-b594bd73dbda')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a526e1-08, col_values=(('external_ids', {'iface-id': 'c2a526e1-0870-43c1-8577-3359acb2102a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:bb:07', 'vm-uuid': '8f420a26-49d6-474d-8c32-750e9167564e'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: INFO os_vif [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08')
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:06:bb:07, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:20:33 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:33 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:33 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b96efa-fa92-44b6-a0fa-6213a42c1f5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:20:33 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b09e000-7011-443a-9012-4649422f0123]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd] added
Dec 06 14:20:33 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4dc84b-3040-487a-8879-68bcb48c7391]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updated VIF entry in instance network info cache for port c2a526e1-0870-43c1-8577-3359acb2102a. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating instance_info_cache with network_info: [{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c94e8f-aff0-4b8f-a227-aeb0489753f0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGdaMVCq {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dc08b385-6a54-48fc-9ff7-f776a323668c req-fb1b5a75-d5da-4712-b453-216637349823 service nova] Releasing lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGdaMVCq" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d34335-9470-41a1-8cb1-0e41c9185c19]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGdaMVCq'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31d4b7-7bdc-4bd1-9dec-e73a5e5f488a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[66182966-15ff-4386-a46e-1d7fa7406a95]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:33 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:33 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:33 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:33 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:20:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055b247-26a4-4cbc-92c5-ed5831c3ae53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260]
Dec 06 14:20:34 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260] successful.
Dec 06 14:20:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb918481-9f81-4174-983e-9b12f43c6500]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67139989-049d-4925-b10d-c123d296e344]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:34 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:34 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:34 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:34 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79123e-f8c9-4be1-b5a9-cf6848ef4b69]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] No waiting events found dispatching network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:34 user nova-compute[75326]: WARNING nova.compute.manager [req-a117cfe6-0fbb-40b8-ad40-46610780c728 req-630ddefd-7ca1-4cd5-99c2-fec9f3083d51 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received unexpected event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 for instance with vm_state building and task_state spawning.
Dec 06 14:20:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26430393331383434', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430393331383434', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'flavor' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:20:35 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:20:35 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:20:35 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:20:35 user nova-compute[75326]:   <serial>eeb03607-4902-46f7-8a27-420222cbbefd</serial>
Dec 06 14:20:35 user nova-compute[75326]: </disk>
Dec 06 14:20:35 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:20:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Instance spawned successfully.
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:35 user nova-compute[75326]: WARNING nova.compute.manager [req-b5f3f250-7e97-4cc8-9e7f-fa50c4b8747f req-f465c8f6-491c-48dc-adef-0535fb3ce8da service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state building and task_state spawning.
Dec 06 14:20:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:35 user nova-compute[75326]: INFO nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Took 7.37 seconds to spawn the instance on the hypervisor.
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:35 user nova-compute[75326]: INFO nova.compute.manager [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Took 8.56 seconds to build instance.
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-08010f1c-9c76-492e-9ccb-8b7b50536c79 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.691s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No VIF found with MAC fa:16:3e:08:9e:30, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-832c8aca-b2c8-459d-bf35-8ff34c0c581c tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.115s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:36 user nova-compute[75326]: INFO nova.compute.manager [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Rescuing
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:37 user nova-compute[75326]: WARNING nova.compute.manager [req-9425f49d-52f9-4cc4-b0ae-5c2951285731 req-f9dc1656-a6a9-45f3-83c4-3f158cdc528b service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state building and task_state spawning.
Dec 06 14:20:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:37 user nova-compute[75326]: WARNING nova.compute.manager [req-737abd36-a1a2-4cf8-a973-4f96b39c814f req-3b5e0781-3e8b-40e8-84f9-d14a48a0c3a4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state active and task_state rescuing.
Dec 06 14:20:37 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 is timed out.
Dec 06 14:20:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully detached device vdc from instance fcd18b74-f5a2-4782-8a8f-bc9012497546 from the live domain config.
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdAZTeHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:20:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b7f81d-0ea7-4d06-aff8-d09de31f0930]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:20:37 user nova-compute[75326]: No targets found.
Dec 06 14:20:37 user nova-compute[75326]: iSNS:
Dec 06 14:20:37 user nova-compute[75326]: No targets found.
Dec 06 14:20:37 user nova-compute[75326]: STATIC:
Dec 06 14:20:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c
Dec 06 14:20:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:20:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:37 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:20:37 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:20:37 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:20:37 user nova-compute[75326]: FIRMWARE:
Dec 06 14:20:37 user nova-compute[75326]: No targets found.
Dec 06 14:20:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:20:37 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:20:37 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c407cd82-fa1d-4482-9143-767f83c058cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691e99e-4251-421a-b51d-5dd6b5d774c3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:37 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:37 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c (non-flash)
Dec 06 14:20:37 user nova-compute[75326]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:37 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43e2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d87bd-68b3-47ca-b2a7-f9f90baa2bfc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e328e-6d88-4414-b292-7e2158dcd98d]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea94cdc1-d3ca-4900-9be7-2cbeaf453bbf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance spawned successfully.
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[961ae52e-112c-4949-83a3-a19bda3da768]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8b78d-de2c-497f-b196-7ba3dd789ae5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a86cd67-ec22-4229-bf19-f8ecd0467fc5]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260]
Dec 06 14:20:37 user nova-compute[75326]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c, portal: 172.16.0.220,3260] successful.
Dec 06 14:20:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6056e1-a183-47af-a443-99d799bc509c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0fb14-12bd-42fc-8570-27ed018084a7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] <== disconnect_volume: return (404ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:20:38 user nova-compute[75326]: INFO nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Took 6.61 seconds to spawn the instance on the hypervisor.
Dec 06 14:20:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance destroyed successfully.
Dec 06 14:20:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attempting a stable device rescue
Dec 06 14:20:38 user nova-compute[75326]: INFO nova.compute.manager [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Took 7.69 seconds to build instance.
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-62c8e173-0be7-4783-9ff8-340e81061221 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.853s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:20:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Creating image(s)
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "4365e25d315993c46cd6bfdc8893abb226f762ae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "4365e25d315993c46cd6bfdc8893abb226f762ae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'flavor' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8/disk --force-share --output=json" returned: 0 in 1.146s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d8473c3f-bd94-4157-adfd-8f810d25204d tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.513s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:39 user nova-compute[75326]: WARNING nova.compute.manager [req-370c4bab-19a9-4c2f-a991-af6c292bbc1d req-0d776fc4-1acf-44e2-b4a2-36f8a40c063b service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state active and task_state rescuing.
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.part --force-share --output=json" returned: 0 in 0.216s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG nova.virt.images [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] a9aba1d1-e1cf-4cde-805d-18e67c75a66c was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.part /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.part /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.converted" returned: 0 in 0.920s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae.converted --force-share --output=json" returned: 0 in 0.274s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "4365e25d315993c46cd6bfdc8893abb226f762ae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.588s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "4365e25d315993c46cd6bfdc8893abb226f762ae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "4365e25d315993c46cd6bfdc8893abb226f762ae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:40 user nova-compute[75326]: INFO nova.compute.manager [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Terminating instance
Dec 06 14:20:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:20:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae,backing_fmt=raw /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae,backing_fmt=raw /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue" returned: 0 in 0.066s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "4365e25d315993c46cd6bfdc8893abb226f762ae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'migration_context' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Object Instance<2ccb172c-0758-42c4-ae72-7c115a8c36e5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start _get_guest_xml network_info=[{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "vif_mac": "fa:16:3e:08:9e:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a9aba1d1-e1cf-4cde-805d-18e67c75a66c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '41cadf1f-3a90-481f-baad-e28b7c7e1f03', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2ccb172c-0758-42c4-ae72-7c115a8c36e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'eeb03607-4902-46f7-8a27-420222cbbefd', 'serial': 'eeb03607-4902-46f7-8a27-420222cbbefd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'resources' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Object Instance<2ccb172c-0758-42c4-ae72-7c115a8c36e5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Object Instance<2ccb172c-0758-42c4-ae72-7c115a8c36e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Object Instance<2ccb172c-0758-42c4-ae72-7c115a8c36e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:20:41 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:41 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:20:41 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6665bb2-7a9b-48c9-9d6b-00cccb9c7aee]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LGdaMVCq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 14:20:41 user nova-compute[75326]: node.name = iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:20:41 user nova-compute[75326]: node.tpgt = -1
Dec 06 14:20:41 user nova-compute[75326]: node.startup = automatic
Dec 06 14:20:41 user nova-compute[75326]: node.leading_login = No
Dec 06 14:20:41 user nova-compute[75326]: iface.iscsi_ifacename = default
Dec 06 14:20:41 user nova-compute[75326]: iface.net_ifacename = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.ipaddress = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.prefix_len = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.hwaddress = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.transport_name = tcp
Dec 06 14:20:41 user nova-compute[75326]: iface.initiatorname = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.vlan_id = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.vlan_priority = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.vlan_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.iface_num = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.mtu = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.port = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.bootproto = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.subnet_mask = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.gateway = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_alt_client_id = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_dns = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_learn_iqn = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_vendor_id_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_vendor_id = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.dhcp_slp_da = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.fragmentation = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.gratuitous_arp = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.incoming_forwarding = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.tos_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.tos = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.ttl = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.delayed_ack = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.tcp_nagle = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.tcp_wsf_state = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.tcp_wsf = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.tcp_timer_scale = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.tcp_timestamp = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.redirect = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.def_task_mgmt_timeout = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.header_digest = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.data_digest = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.immediate_data = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.initial_r2t = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.data_seq_inorder = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.data_pdu_inorder = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.erl = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.max_receive_data_len = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.first_burst_len = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.max_outstanding_r2t = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.max_burst_len = 0
Dec 06 14:20:41 user nova-compute[75326]: iface.chap_auth = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.bidi_chap = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.strict_login_compliance = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.discovery_auth = <empty>
Dec 06 14:20:41 user nova-compute[75326]: iface.discovery_logout = <empty>
Dec 06 14:20:41 user nova-compute[75326]: node.discovery_address = <empty>
Dec 06 14:20:41 user nova-compute[75326]: node.discovery_port = 0
Dec 06 14:20:41 user nova-compute[75326]: node.discovery_type = static
Dec 06 14:20:41 user nova-compute[75326]: node.session.initial_cmdsn = 0
Dec 06 14:20:41 user nova-compute[75326]: node.session.initial_login_retry_max = 8
Dec 06 14:20:41 user nova-compute[75326]: node.session.xmit_thread_priority = -20
Dec 06 14:20:41 user nova-compute[75326]: node.session.cmds_max = 128
Dec 06 14:20:41 user nova-compute[75326]: node.session.queue_depth = 32
Dec 06 14:20:41 user nova-compute[75326]: node.session.nr_sessions = 1
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.authmethod = CHAP
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.username = LGdaMVCq
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.password = ***
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.username_in = <empty>
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.password_in = <empty>
Dec 06 14:20:41 user nova-compute[75326]: node.session.auth.chap_algs = MD5
Dec 06 14:20:41 user nova-compute[75326]: node.session.timeo.replacement_timeout = 120
Dec 06 14:20:41 user nova-compute[75326]: node.session.err_timeo.abort_timeout = 15
Dec 06 14:20:41 user nova-compute[75326]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 14:20:41 user nova-compute[75326]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 14:20:41 user nova-compute[75326]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.FastAbort = Yes
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.InitialR2T = No
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.ImmediateData = Yes
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.MaxConnections = 1
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 14:20:41 user nova-compute[75326]: node.session.iscsi.ERL = 0
Dec 06 14:20:41 user nova-compute[75326]: node.session.scan = manual
Dec 06 14:20:41 user nova-compute[75326]: node.session.reopen_max = 0
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].address = 172.16.0.220
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].port = 3260
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].startup = manual
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].tcp.window_size = 524288
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].tcp.type_of_service = 0
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].timeo.logout_timeout = 15
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].timeo.login_timeout = 15
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].timeo.auth_timeout = 45
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.DataDigest = None
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.IFMarker = No
Dec 06 14:20:41 user nova-compute[75326]: node.conn[0].iscsi.OFMarker = No
Dec 06 14:20:41 user nova-compute[75326]: # END RECORD
Dec 06 14:20:41 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eba9e9-0ba6-4054-a6f1-bdf3966c1463]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a06ab8-d93f-41e9-9766-db0aa3aca264]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGdaMVCq {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGdaMVCq" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[42110307-e9dd-4080-a598-eaee85058cd8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-unplugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] No waiting events found dispatching network-vif-unplugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-4470bdd4-35c8-401c-8ba9-fafc35ea85b7 req-ff250fce-0af4-4fb2-abee-2bed2e03d209 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-unplugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGdaMVCq'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e633e6-4210-44b3-bb44-c4327556d2f3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5497033-d339-4044-b826-e035e92743ec]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:41 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:41 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:20:41 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:20:41 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b78a5a-6061-46a0-9cbd-1261ac8e08ed]: (4, ('0 0 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.271s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] <== connect_volume: return (273ms) {'type': 'block', 'scsi_wwn': '26430393331383434', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430393331383434', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-771152837',display_name='tempest-ServerStableDeviceRescueTest-server-771152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-771152837',id=22,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiRKZiuA0wOtFrfJuBFo/XVJP+icvnqrfNzzZ0LGCt5xq1Csi4Kz1+swPwoQCgVKrcf4eLJD6lbTz4j1R2FQIU82S+oXapz4JT0edBe2UPUhAudhHKpLHXoEGmCS4ijLg==',key_name='tempest-keypair-2036139810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08132609a7b6464aa607ab2b5aa67eff',ramdisk_id='',reservation_id='r-gqnm3l0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1187090853',owner_user_name='tempest-ServerStableDeviceRescueTest-1187090853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d7e6b93568f45c5bb4d5f2c660cfbf6',uuid=2ccb172c-0758-42c4-ae72-7c115a8c36e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "vif_mac": "fa:16:3e:08:9e:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converting VIF {"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "vif_mac": "fa:16:3e:08:9e:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.base [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Object Instance<2ccb172c-0758-42c4-ae72-7c115a8c36e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:20:41 user nova-compute[75326]:   <uuid>2ccb172c-0758-42c4-ae72-7c115a8c36e5</uuid>
Dec 06 14:20:41 user nova-compute[75326]:   <name>instance-00000016</name>
Dec 06 14:20:41 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:20:41 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:20:41 user nova-compute[75326]:   <metadata>
Dec 06 14:20:41 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:20:41 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-771152837</nova:name>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:20:41</nova:creationTime>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:20:41 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:20:41 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:owner>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:user uuid="0d7e6b93568f45c5bb4d5f2c660cfbf6">tempest-ServerStableDeviceRescueTest-1187090853-project-member</nova:user>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:project uuid="08132609a7b6464aa607ab2b5aa67eff">tempest-ServerStableDeviceRescueTest-1187090853</nova:project>
Dec 06 14:20:41 user nova-compute[75326]:       </nova:owner>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:20:41 user nova-compute[75326]:       <nova:ports>
Dec 06 14:20:41 user nova-compute[75326]:         <nova:port uuid="2954ec2e-e2ea-400c-8b68-79218917bc75">
Dec 06 14:20:41 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:20:41 user nova-compute[75326]:         </nova:port>
Dec 06 14:20:41 user nova-compute[75326]:       </nova:ports>
Dec 06 14:20:41 user nova-compute[75326]:     </nova:instance>
Dec 06 14:20:41 user nova-compute[75326]:   </metadata>
Dec 06 14:20:41 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:20:41 user nova-compute[75326]:     <system>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="serial">2ccb172c-0758-42c4-ae72-7c115a8c36e5</entry>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="uuid">2ccb172c-0758-42c4-ae72-7c115a8c36e5</entry>
Dec 06 14:20:41 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:20:41 user nova-compute[75326]:     </system>
Dec 06 14:20:41 user nova-compute[75326]:   </sysinfo>
Dec 06 14:20:41 user nova-compute[75326]:   <os>
Dec 06 14:20:41 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:20:41 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:20:41 user nova-compute[75326]:   </os>
Dec 06 14:20:41 user nova-compute[75326]:   <features>
Dec 06 14:20:41 user nova-compute[75326]:     <acpi/>
Dec 06 14:20:41 user nova-compute[75326]:     <apic/>
Dec 06 14:20:41 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:20:41 user nova-compute[75326]:   </features>
Dec 06 14:20:41 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:20:41 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:20:41 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:20:41 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:20:41 user nova-compute[75326]:   </clock>
Dec 06 14:20:41 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:20:41 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:20:41 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:20:41 user nova-compute[75326]:   </cpu>
Dec 06 14:20:41 user nova-compute[75326]:   <devices>
Dec 06 14:20:41 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:41 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:41 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk"/>
Dec 06 14:20:41 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:20:41 user nova-compute[75326]:     </disk>
Dec 06 14:20:41 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:20:41 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:20:41 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:20:41 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:20:41 user nova-compute[75326]:       <serial>eeb03607-4902-46f7-8a27-420222cbbefd</serial>
Dec 06 14:20:41 user nova-compute[75326]:     </disk>
Dec 06 14:20:41 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:20:41 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:20:41 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue"/>
Dec 06 14:20:41 user nova-compute[75326]:       <target dev="vdc" bus="virtio"/>
Dec 06 14:20:41 user nova-compute[75326]:       <boot order="1"/>
Dec 06 14:20:41 user nova-compute[75326]:     </disk>
Dec 06 14:20:41 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:20:41 user nova-compute[75326]:       <mac address="fa:16:3e:08:9e:30"/>
Dec 06 14:20:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:41 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:20:41 user nova-compute[75326]:       <target dev="tap2954ec2e-e2"/>
Dec 06 14:20:41 user nova-compute[75326]:     </interface>
Dec 06 14:20:41 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:20:41 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/console.log" append="off"/>
Dec 06 14:20:41 user nova-compute[75326]:     </serial>
Dec 06 14:20:41 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:20:41 user nova-compute[75326]:     <video>
Dec 06 14:20:41 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:20:41 user nova-compute[75326]:     </video>
Dec 06 14:20:41 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:20:41 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:20:41 user nova-compute[75326]:     </rng>
Dec 06 14:20:41 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:20:41 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:20:41 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:20:41 user nova-compute[75326]:     </memballoon>
Dec 06 14:20:41 user nova-compute[75326]:   </devices>
Dec 06 14:20:41 user nova-compute[75326]: </domain>
Dec 06 14:20:41 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:20:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Instance destroyed successfully.
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lazy-loading 'resources' on Instance uuid fcd18b74-f5a2-4782-8a8f-bc9012497546 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:20:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance destroyed successfully.
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1891786937',display_name='tempest-AttachVolumeTestJSON-server-1891786937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1891786937',id=26,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsCQaP8OASBFHQAjz97e9RXy0/6FgXUtBGK4aKGM4uG8Ihmn9jNxpB4ba8DabKdd2DWbPJGJZw4OrS3JoAu6cCJEPT4tiZkIK5UHITo2msCezojooLrbrkLhswTLIZbrw==',key_name='tempest-keypair-1838938509',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83c49428c1da4c6592df6be7874c46f7',ramdisk_id='',reservation_id='r-40vgdxf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-653396495',owner_user_name='tempest-AttachVolumeTestJSON-653396495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='691bec5c3db54e5d8bedc6193b976c01',uuid=fcd18b74-f5a2-4782-8a8f-bc9012497546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converting VIF {"id": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "address": "fa:16:3e:41:34:dc", "network": {"id": "c13104ea-eaa9-4d1a-9529-24ff4b0c4420", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1338449979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c49428c1da4c6592df6be7874c46f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94713f4b-10", "ovs_interfaceid": "94713f4b-10e5-4130-b9eb-ffa20c7cada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG os_vif [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94713f4b-10, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25feeb54-d9e4-45c9-9b39-eae90bd69224) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:41 user nova-compute[75326]: INFO os_vif [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:34:dc,bridge_name='br-int',has_traffic_filtering=True,id=94713f4b-10e5-4130-b9eb-ffa20c7cada9,network=Network(c13104ea-eaa9-4d1a-9529-24ff4b0c4420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94713f4b-10')
Dec 06 14:20:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Deleting instance files /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546_del
Dec 06 14:20:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Deletion of /opt/stack/data/nova/instances/fcd18b74-f5a2-4782-8a8f-bc9012497546_del complete
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:20:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] No VIF found with MAC fa:16:3e:08:9e:30, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:20:42 user nova-compute[75326]: INFO nova.compute.manager [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Took 1.04 seconds to destroy the instance on the hypervisor.
Dec 06 14:20:42 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:20:42 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:20:42 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:20:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:20:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:20:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] Acquiring lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] No waiting events found dispatching network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:46 user nova-compute[75326]: WARNING nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received unexpected event network-vif-plugged-94713f4b-10e5-4130-b9eb-ffa20c7cada9 for instance with vm_state active and task_state deleting.
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Received event network-vif-deleted-94713f4b-10e5-4130-b9eb-ffa20c7cada9 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:46 user nova-compute[75326]: INFO nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Neutron deleted interface 94713f4b-10e5-4130-b9eb-ffa20c7cada9; detaching it from the instance and deleting it from the info cache
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:46 user nova-compute[75326]: WARNING nova.compute.manager [req-d91a4fd4-96db-4395-99f5-d62c9c04a9bb req-41f8942d-4aea-41e5-b69c-a0c7f5e10f19 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state active and task_state rescuing.
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:20:46 user nova-compute[75326]: WARNING nova.compute.manager [req-c3e69f3b-2921-49cc-9ea0-746bacf80e41 req-bf184e15-cefa-430b-80db-2b2354c91be4 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state active and task_state rescuing.
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ee9a050b-63c3-40a6-aa36-42b3f25f9051 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:20:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:46 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7788MB free_disk=25.14669418334961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:46 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Took 4.29 seconds to deallocate network for instance.
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e6fb398-ce1b-4065-8044-c58e52ef0460 req-24f1c51c-3fe3-4876-8329-772def4a3529 service nova] [instance: fcd18b74-f5a2-4782-8a8f-bc9012497546] Detach interface failed, port_id=94713f4b-10e5-4130-b9eb-ffa20c7cada9, reason: Instance fcd18b74-f5a2-4782-8a8f-bc9012497546 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance fcd18b74-f5a2-4782-8a8f-bc9012497546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 9ff062df-5a61-4b89-8547-b668913bf4b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance d1956e9c-87a4-48b8-9413-ef2d701893a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.419s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:20:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:47 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:20:47 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:20:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:47 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Deleted allocations for instance fcd18b74-f5a2-4782-8a8f-bc9012497546
Dec 06 14:20:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b92227c-3cfd-44fc-b904-9bd3b2d1109b tempest-AttachVolumeTestJSON-653396495 tempest-AttachVolumeTestJSON-653396495-project-member] Lock "fcd18b74-f5a2-4782-8a8f-bc9012497546" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.398s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:20:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:20:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:20:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:23 user nova-compute[75326]: INFO nova.compute.manager [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Terminating instance
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-unplugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] No waiting events found dispatching network-vif-unplugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-b341bb25-c370-48c1-a6c2-2a1c3be9763b req-2bb8872b-2c10-44b2-9f8a-80a68ecda450 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-unplugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Instance destroyed successfully.
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lazy-loading 'resources' on Instance uuid 9ff062df-5a61-4b89-8547-b668913bf4b8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671987779',display_name='tempest-VolumesActionsTest-instance-671987779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671987779',id=29,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-rkcs1360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:19:39Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=9ff062df-5a61-4b89-8547-b668913bf4b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "address": "fa:16:3e:5f:25:28", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244649c3-bb", "ovs_interfaceid": "244649c3-bbeb-42cc-bd9f-a8a94bfc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:21:23 user nova-compute[75326]: DEBUG os_vif [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244649c3-bb, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59d0b411-21ef-4258-9617-aa998bd3823d) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:24 user nova-compute[75326]: INFO os_vif [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:25:28,bridge_name='br-int',has_traffic_filtering=True,id=244649c3-bbeb-42cc-bd9f-a8a94bfc27d1,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244649c3-bb')
Dec 06 14:21:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Deleting instance files /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8_del
Dec 06 14:21:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Deletion of /opt/stack/data/nova/instances/9ff062df-5a61-4b89-8547-b668913bf4b8_del complete
Dec 06 14:21:24 user nova-compute[75326]: INFO nova.compute.manager [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 14:21:24 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:21:24 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Took 0.50 seconds to deallocate network for instance.
Dec 06 14:21:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:21:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:25 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Deleted allocations for instance 9ff062df-5a61-4b89-8547-b668913bf4b8
Dec 06 14:21:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-52926887-9fce-4d7b-8f7c-69e16ed770bb tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:21:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] Acquiring lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] Lock "9ff062df-5a61-4b89-8547-b668913bf4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] No waiting events found dispatching network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:21:25 user nova-compute[75326]: WARNING nova.compute.manager [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received unexpected event network-vif-plugged-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 for instance with vm_state deleted and task_state None.
Dec 06 14:21:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-d52a9b00-0279-4f21-ab63-11f5f664d27b req-af772a2f-8742-4514-8c66-86796a774c70 service nova] [instance: 9ff062df-5a61-4b89-8547-b668913bf4b8] Received event network-vif-deleted-244649c3-bbeb-42cc-bd9f-a8a94bfc27d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:21:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:21:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:21:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:21:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:21:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.045677185058594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance d1956e9c-87a4-48b8-9413-ef2d701893a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:21:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:21:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing instance network info cache due to event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:21:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:21:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updated VIF entry in instance network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:21:50 user nova-compute[75326]: DEBUG nova.network.neutron [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:21:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-675fc11b-f15e-4e50-98f3-ee58b0d8ea7d req-acdb0090-23b3-46fb-998c-e22fef5f67d6 service nova] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:21:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:21:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:21:51 user nova-compute[75326]: INFO nova.compute.manager [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Detaching volume 5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:21:51 user nova-compute[75326]: INFO nova.virt.block_device [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Attempting to driver detach volume 5382d6ae-49b4-41be-978a-7eee414e5d0e from mountpoint /dev/vdb
Dec 06 14:21:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Attempting to detach device vdb from instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:21:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:21:51 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:21:51 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:21:51 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:21:51 user nova-compute[75326]:   <serial>5382d6ae-49b4-41be-978a-7eee414e5d0e</serial>
Dec 06 14:21:51 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:21:51 user nova-compute[75326]: </disk>
Dec 06 14:21:51 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:21:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully detached device vdb from instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb from the persistent domain config.
Dec 06 14:21:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:21:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:21:51 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:21:51 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:21:51 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:21:51 user nova-compute[75326]:   <serial>5382d6ae-49b4-41be-978a-7eee414e5d0e</serial>
Dec 06 14:21:51 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:21:51 user nova-compute[75326]: </disk>
Dec 06 14:21:51 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:21:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing instance network info cache due to event network-changed-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] Acquiring lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] Acquired lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Refreshing network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updated VIF entry in instance network info cache for port ef51fec1-2bd2-4742-bbb6-8c54c05e06bd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [{"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:21:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-91848471-1b1d-4076-8b92-29be358fd12d req-6e49a502-1e4b-4816-b457-e671d7286a67 service nova] Releasing lock "refresh_cache-7626a81f-f1bc-4aef-be81-b5979fc9bbcb" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:21:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:21:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing instance network info cache due to event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG nova.network.neutron [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:11 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb is timed out.
Dec 06 14:22:11 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully detached device vdb from instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb from the live domain config.
Dec 06 14:22:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njxZRtwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:11 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b9fb5-024d-4cb2-bc95-88280897b2ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:22:11 user nova-compute[75326]: No targets found.
Dec 06 14:22:11 user nova-compute[75326]: iSNS:
Dec 06 14:22:11 user nova-compute[75326]: No targets found.
Dec 06 14:22:11 user nova-compute[75326]: STATIC:
Dec 06 14:22:11 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:22:11 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:11 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:11 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e
Dec 06 14:22:11 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:11 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:11 user nova-compute[75326]: FIRMWARE:
Dec 06 14:22:11 user nova-compute[75326]: No targets found.
Dec 06 14:22:11 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:22:11 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:22:11 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51a3d2-b0d0-47c2-ad6d-9831980bfd85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaf195-83d7-4dd1-bf30-aa3952c551ca]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:22:12 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e (non-flash)
Dec 06 14:22:12 user nova-compute[75326]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc12bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36d2f69-5d63-4835-8c8f-87ff77a6a7be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4dfe00-93f4-47eb-a50d-539361a9f9da]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db7a3b-e1c8-4ebc-8e44-a748236933da]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f280f71-1b60-49f0-b04b-df197d9b132f]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fba4db-7179-4d3c-b362-c8c2aa06c4bd]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2621bf67-7837-4d26-9369-e70b1e0e477d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260]
Dec 06 14:22:12 user nova-compute[75326]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5382d6ae-49b4-41be-978a-7eee414e5d0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[58066b00-7a9c-4a42-8c0a-63f0d88a476c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== disconnect_volume: return (348ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'flavor' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updated VIF entry in instance network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-309aed1c-b56a-4c34-90b8-f0878c5d8c23 req-b7ce09d5-9130-4f79-a85c-e8ab8297633d service nova] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:12 user nova-compute[75326]: INFO nova.compute.manager [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Attaching volume b2f0543f-9bef-4190-afa4-4eb03ac51e2a to /dev/vdb
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.utils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a42c15-e436-4376-94d1-6fe4fc0fbc06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ac12fe-f98d-49c7-90e8-6f0f99964667]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e8d80-3ad6-4962-a55d-0aa7c557e097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba38c4-7da6-4f06-9db3-7ec8f5c59ba6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:12 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:22:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d54ee-653f-4bef-b42b-96d09323c936]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG os_brick.utils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:12 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating existing volume attachment record: 35597dc9-23e2-4fc4-88ed-b07a2317dab9 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:22:13 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b75e702-d28a-44ac-b6b9-1475e6d00beb tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:14 user nova-compute[75326]: INFO nova.compute.manager [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Unshelving
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_requests' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'numa_topology' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:22:14 user nova-compute[75326]: INFO nova.compute.claims [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Claim successful on node user
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:22:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.408s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:22:15 user nova-compute[75326]: INFO nova.compute.claims [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Claim successful on node user
Dec 06 14:22:15 user nova-compute[75326]: INFO nova.network.neutron [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating port b5ea5d62-6081-4079-b059-c45be12249c6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:22:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:22:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.policy [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61037bed82704e35b06d34c6835dbcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42606f35dde84948b771234dc36c558d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:22:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Creating image(s)
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "/opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "/opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "/opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing instance network info cache due to event network-changed-b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] Acquiring lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk 1073741824" returned: 0 in 0.063s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:22:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Creating image(s)
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'trusted_certs' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] Acquired lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Refreshing network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Successfully created port: 9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.objects.base [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<aae09742-d2f6-4291-bd41-0337df3ce9c1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:22:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json" returned: 0 in 1.008s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Cannot resize image /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Ensure instance console log exists: /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Successfully updated port: 9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquired lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.virt.images [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] 57b59df1-bf27-4266-9c3d-fb4b1e25a04a was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.part /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-changed-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Refreshing instance network info cache due to event network-changed-9592961c-72c3-45c8-bfe4-79aefd4cd792. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] Acquiring lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Updating instance_info_cache with network_info: [{"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Releasing lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Instance network_info: |[{"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] Acquired lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Refreshing network info cache for port 9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Start _get_guest_xml network_info=[{"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:22:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.part /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.converted" returned: 0 in 0.709s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updated VIF entry in instance network info cache for port b5ea5d62-6081-4079-b059-c45be12249c6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.neutron [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2001634163',display_name='tempest-VolumesActionsTest-instance-2001634163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2001634163',id=33,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-pfgjg1lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:16Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=c06e361b-368a-422a-a62c-d92bc09f0585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lazy-loading 'pci_devices' on Instance uuid c06e361b-368a-422a-a62c-d92bc09f0585 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-19841413-79cb-4b5c-8ec0-88302d7e1e49 req-1009ae07-b632-41ca-8915-bd83f1f222a5 service nova] Releasing lock "refresh_cache-aae09742-d2f6-4291-bd41-0337df3ce9c1" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:22:18 user nova-compute[75326]:   <uuid>c06e361b-368a-422a-a62c-d92bc09f0585</uuid>
Dec 06 14:22:18 user nova-compute[75326]:   <name>instance-00000021</name>
Dec 06 14:22:18 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:22:18 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:22:18 user nova-compute[75326]:   <metadata>
Dec 06 14:22:18 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:22:18 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:name>tempest-VolumesActionsTest-instance-2001634163</nova:name>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:22:18</nova:creationTime>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:22:18 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:22:18 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:owner>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:user uuid="61037bed82704e35b06d34c6835dbcb1">tempest-VolumesActionsTest-969285127-project-member</nova:user>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:project uuid="42606f35dde84948b771234dc36c558d">tempest-VolumesActionsTest-969285127</nova:project>
Dec 06 14:22:18 user nova-compute[75326]:       </nova:owner>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:22:18 user nova-compute[75326]:       <nova:ports>
Dec 06 14:22:18 user nova-compute[75326]:         <nova:port uuid="9592961c-72c3-45c8-bfe4-79aefd4cd792">
Dec 06 14:22:18 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 14:22:18 user nova-compute[75326]:         </nova:port>
Dec 06 14:22:18 user nova-compute[75326]:       </nova:ports>
Dec 06 14:22:18 user nova-compute[75326]:     </nova:instance>
Dec 06 14:22:18 user nova-compute[75326]:   </metadata>
Dec 06 14:22:18 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:22:18 user nova-compute[75326]:     <system>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="serial">c06e361b-368a-422a-a62c-d92bc09f0585</entry>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="uuid">c06e361b-368a-422a-a62c-d92bc09f0585</entry>
Dec 06 14:22:18 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:22:18 user nova-compute[75326]:     </system>
Dec 06 14:22:18 user nova-compute[75326]:   </sysinfo>
Dec 06 14:22:18 user nova-compute[75326]:   <os>
Dec 06 14:22:18 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:22:18 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:22:18 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:22:18 user nova-compute[75326]:   </os>
Dec 06 14:22:18 user nova-compute[75326]:   <features>
Dec 06 14:22:18 user nova-compute[75326]:     <acpi/>
Dec 06 14:22:18 user nova-compute[75326]:     <apic/>
Dec 06 14:22:18 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:22:18 user nova-compute[75326]:   </features>
Dec 06 14:22:18 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:22:18 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:22:18 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:22:18 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:22:18 user nova-compute[75326]:   </clock>
Dec 06 14:22:18 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:22:18 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:22:18 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:22:18 user nova-compute[75326]:   </cpu>
Dec 06 14:22:18 user nova-compute[75326]:   <devices>
Dec 06 14:22:18 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:22:18 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:22:18 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk"/>
Dec 06 14:22:18 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:22:18 user nova-compute[75326]:     </disk>
Dec 06 14:22:18 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:22:18 user nova-compute[75326]:       <mac address="fa:16:3e:03:f0:ff"/>
Dec 06 14:22:18 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:18 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:22:18 user nova-compute[75326]:       <target dev="tap9592961c-72"/>
Dec 06 14:22:18 user nova-compute[75326]:     </interface>
Dec 06 14:22:18 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:22:18 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/console.log" append="off"/>
Dec 06 14:22:18 user nova-compute[75326]:     </serial>
Dec 06 14:22:18 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:22:18 user nova-compute[75326]:     <video>
Dec 06 14:22:18 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:18 user nova-compute[75326]:     </video>
Dec 06 14:22:18 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:22:18 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:22:18 user nova-compute[75326]:     </rng>
Dec 06 14:22:18 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:22:18 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:22:18 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:22:18 user nova-compute[75326]:     </memballoon>
Dec 06 14:22:18 user nova-compute[75326]:   </devices>
Dec 06 14:22:18 user nova-compute[75326]: </domain>
Dec 06 14:22:18 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2001634163',display_name='tempest-VolumesActionsTest-instance-2001634163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2001634163',id=33,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-pfgjg1lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:16Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=c06e361b-368a-422a-a62c-d92bc09f0585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG os_vif [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4b3cf4-9143-5372-ba61-0ee396ca21b0', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9592961c-72, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9592961c-72, col_values=(('qos', UUID('5a9ccbd9-7032-4b7f-967c-b89c6ff5a815')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9592961c-72, col_values=(('external_ids', {'iface-id': '9592961c-72c3-45c8-bfe4-79aefd4cd792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f0:ff', 'vm-uuid': 'c06e361b-368a-422a-a62c-d92bc09f0585'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.175s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:18 user nova-compute[75326]: INFO os_vif [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72')
Dec 06 14:22:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] No VIF found with MAC fa:16:3e:03:f0:ff, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json" returned: 0 in 0.220s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Updated VIF entry in instance network info cache for port 9592961c-72c3-45c8-bfe4-79aefd4cd792. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Updating instance_info_cache with network_info: [{"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9c0e2cc-84c7-4621-a40a-e47614cffac3 req-a7ae6ef9-800a-4452-bc04-0aee4df983c9 service nova] Releasing lock "refresh_cache-c06e361b-368a-422a-a62c-d92bc09f0585" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json" returned: 0 in 0.204s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e,backing_fmt=raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e,backing_fmt=raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk 1073741824" returned: 0 in 0.055s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "76ec96802d5dc901366ed28ee341c58681ff0c8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing instance network info cache due to event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] Acquiring lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] Acquired lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.network.neutron [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'migration_context' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG nova.objects.base [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<aae09742-d2f6-4291-bd41-0337df3ce9c1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Rebasing disk image.
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 -F raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updated VIF entry in instance network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating instance_info_cache with network_info: [{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fa253704-baa5-4739-af28-9a19a33cf4bf req-f205f644-b13a-4746-beae-96d9b1775e15 service nova] Releasing lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:20 user nova-compute[75326]: INFO nova.compute.manager [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Attaching volume 8e36dee8-3b21-471b-bfb1-28d54cc08a07 to /dev/vdb
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.utils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3df8fb-dee3-4dea-9617-1c6622d8a76b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b1a7a-1e32-474b-bbec-8a11653b2ca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691abea-c654-4736-b23d-3062f301bee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[991dfb6c-f8c1-44a1-97d7-052b818cf8e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:20 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:22:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2177b72-ed65-4f59-930e-91b878053cbd]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG os_brick.utils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:20 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating existing volume attachment record: 0a5b63ad-9f8e-4411-b18f-01dfa5fd93e2 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:21 user nova-compute[75326]: WARNING nova.compute.manager [req-249bb8ac-2edc-411b-b7db-2f54c8f17ac0 req-6bd04bff-3f79-4433-a1fc-6e7535c9222b service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received unexpected event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with vm_state building and task_state spawning.
Dec 06 14:22:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-changed-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Refreshing instance network info cache due to event network-changed-c2a526e1-0870-43c1-8577-3359acb2102a. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] Acquiring lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] Acquired lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.network.neutron [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Refreshing network info cache for port c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 -F raw /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk" returned: 0 in 3.035s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start _get_guest_xml network_info=[{"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9c526320047d511becae4b1071cd90a8',container_format='bare',created_at=2023-12-06T14:20:21Z,direct_url=<?>,disk_format='qcow2',id=57b59df1-bf27-4266-9c3d-fb4b1e25a04a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1098097890-shelved',owner='f7c14bbf4b604b6282ec7c5e925c2514',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T14:20:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:22:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9c526320047d511becae4b1071cd90a8',container_format='bare',created_at=2023-12-06T14:20:21Z,direct_url=<?>,disk_format='qcow2',id=57b59df1-bf27-4266-9c3d-fb4b1e25a04a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1098097890-shelved',owner='f7c14bbf4b604b6282ec7c5e925c2514',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T14:20:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'vcpu_model' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.objects.base [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<aae09742-d2f6-4291-bd41-0337df3ce9c1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='57b59df1-bf27-4266-9c3d-fb4b1e25a04a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-606551783',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:18:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:20:25.712371',shelved_host='user',shelved_image_id='57b59df1-bf27-4266-9c3d-fb4b1e25a04a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'pci_devices' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.objects.base [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Object Instance<aae09742-d2f6-4291-bd41-0337df3ce9c1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:22:22 user nova-compute[75326]:   <uuid>aae09742-d2f6-4291-bd41-0337df3ce9c1</uuid>
Dec 06 14:22:22 user nova-compute[75326]:   <name>instance-0000001c</name>
Dec 06 14:22:22 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:22:22 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:22:22 user nova-compute[75326]:   <metadata>
Dec 06 14:22:22 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:22:22 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1098097890</nova:name>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:22:22</nova:creationTime>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:22:22 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:22:22 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:owner>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:user uuid="921ceb47e4174eb0b5a47fe727d4a1d2">tempest-AttachVolumeShelveTestJSON-82698496-project-member</nova:user>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:project uuid="f7c14bbf4b604b6282ec7c5e925c2514">tempest-AttachVolumeShelveTestJSON-82698496</nova:project>
Dec 06 14:22:22 user nova-compute[75326]:       </nova:owner>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:root type="image" uuid="57b59df1-bf27-4266-9c3d-fb4b1e25a04a"/>
Dec 06 14:22:22 user nova-compute[75326]:       <nova:ports>
Dec 06 14:22:22 user nova-compute[75326]:         <nova:port uuid="b5ea5d62-6081-4079-b059-c45be12249c6">
Dec 06 14:22:22 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:22:22 user nova-compute[75326]:         </nova:port>
Dec 06 14:22:22 user nova-compute[75326]:       </nova:ports>
Dec 06 14:22:22 user nova-compute[75326]:     </nova:instance>
Dec 06 14:22:22 user nova-compute[75326]:   </metadata>
Dec 06 14:22:22 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:22:22 user nova-compute[75326]:     <system>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="serial">aae09742-d2f6-4291-bd41-0337df3ce9c1</entry>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="uuid">aae09742-d2f6-4291-bd41-0337df3ce9c1</entry>
Dec 06 14:22:22 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:22:22 user nova-compute[75326]:     </system>
Dec 06 14:22:22 user nova-compute[75326]:   </sysinfo>
Dec 06 14:22:22 user nova-compute[75326]:   <os>
Dec 06 14:22:22 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:22:22 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:22:22 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:22:22 user nova-compute[75326]:   </os>
Dec 06 14:22:22 user nova-compute[75326]:   <features>
Dec 06 14:22:22 user nova-compute[75326]:     <acpi/>
Dec 06 14:22:22 user nova-compute[75326]:     <apic/>
Dec 06 14:22:22 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:22:22 user nova-compute[75326]:   </features>
Dec 06 14:22:22 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:22:22 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:22:22 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:22:22 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:22:22 user nova-compute[75326]:   </clock>
Dec 06 14:22:22 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:22:22 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:22:22 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:22:22 user nova-compute[75326]:   </cpu>
Dec 06 14:22:22 user nova-compute[75326]:   <devices>
Dec 06 14:22:22 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:22:22 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:22:22 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk"/>
Dec 06 14:22:22 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:22:22 user nova-compute[75326]:     </disk>
Dec 06 14:22:22 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:22:22 user nova-compute[75326]:       <mac address="fa:16:3e:a7:f8:40"/>
Dec 06 14:22:22 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:22 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:22:22 user nova-compute[75326]:       <target dev="tapb5ea5d62-60"/>
Dec 06 14:22:22 user nova-compute[75326]:     </interface>
Dec 06 14:22:22 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:22:22 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/console.log" append="off"/>
Dec 06 14:22:22 user nova-compute[75326]:     </serial>
Dec 06 14:22:22 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:22:22 user nova-compute[75326]:     <video>
Dec 06 14:22:22 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:22 user nova-compute[75326]:     </video>
Dec 06 14:22:22 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:22:22 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:22:22 user nova-compute[75326]:     </rng>
Dec 06 14:22:22 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:22:22 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:22:22 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:22:22 user nova-compute[75326]:     </memballoon>
Dec 06 14:22:22 user nova-compute[75326]:   </devices>
Dec 06 14:22:22 user nova-compute[75326]: </domain>
Dec 06 14:22:22 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='57b59df1-bf27-4266-9c3d-fb4b1e25a04a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-606551783',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:18:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member',shelved_at='2023-12-06T14:20:25.712371',shelved_host='user',shelved_image_id='57b59df1-bf27-4266-9c3d-fb4b1e25a04a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG os_vif [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b37010bb-bb0d-50ce-95fd-eabec9a9f215', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5ea5d62-60, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5ea5d62-60, col_values=(('qos', UUID('b07d330f-810e-45ec-a85b-12777f6b19d2')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5ea5d62-60, col_values=(('external_ids', {'iface-id': 'b5ea5d62-6081-4079-b059-c45be12249c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f8:40', 'vm-uuid': 'aae09742-d2f6-4291-bd41-0337df3ce9c1'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:22 user nova-compute[75326]: INFO os_vif [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60')
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] No VIF found with MAC fa:16:3e:a7:f8:40, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'flavor' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.network.neutron [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updated VIF entry in instance network info cache for port c2a526e1-0870-43c1-8577-3359acb2102a. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.network.neutron [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating instance_info_cache with network_info: [{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99b621f2-6e2e-4a75-b37d-3cf169d38fda req-ff12d26e-5a72-471b-9e9f-a8cf2b719de4 service nova] Releasing lock "refresh_cache-8f420a26-49d6-474d-8c32-750e9167564e" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:23 user nova-compute[75326]: WARNING nova.compute.manager [req-0316c608-fc62-47a1-ba3a-4a4e2fabe68b req-0eecb7f7-4400-4984-b586-ab677585d6a3 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received unexpected event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with vm_state building and task_state spawning.
Dec 06 14:22:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:23 user nova-compute[75326]: INFO nova.compute.manager [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attaching volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5 to /dev/vdb
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:22:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Instance spawned successfully.
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:22:24 user nova-compute[75326]: INFO nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Took 8.00 seconds to spawn the instance on the hypervisor.
Dec 06 14:22:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.utils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: INFO nova.compute.manager [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Took 9.26 seconds to build instance.
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.085s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab675675-cce9-4743-a217-b2d30630dbfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f1bc68-f071-419f-847a-226b78020114]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-def7c815-8b6b-47de-8e0f-5a17cbb192c8 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.457s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1223421-e2c6-4dde-a563-04b6939aa710]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62103ef-58a3-48e5-9ec9-e9c2e1a0da6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:24 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f743d23-31b5-49a7-9a71-9cbdbf016045]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.utils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== get_connector_properties: return (249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating existing volume attachment record: 6851ed5c-0f49-4746-a2e9-f74f5c6987ff {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJCXeTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:24 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:24 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:24 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c63ba7-f396-43b5-ab4f-36936d318347]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:22:24 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3ec078-e306-46ec-b78a-a3be13a7d495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a] added
Dec 06 14:22:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[570cf841-6cd7-4a57-b1c2-9ff2585ab006]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affa6f0-0d04-487f-b5f4-357a80c25bb1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzJCXeTh {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzJCXeTh" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa378af-5518-431f-8e4a-acfa886533a3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzJCXeTh'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c60f35a-c4b9-47a8-914a-61e878514c85]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6a5ed-eed3-418f-a933-e77cb9a12e35]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[94829b44-08d8-41dd-94f0-1eb829623222]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260]
Dec 06 14:22:24 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.147s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ce522-9575-4d36-9918-555f5f54fbf9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441d786-bfba-4b08-b62b-17ef5639da85]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:25 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:25 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dbac64-d088-4f97-b910-df1fdef44b1a]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJCXeTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:25 user nova-compute[75326]: WARNING nova.compute.manager [req-a972857a-4906-4f6c-97da-c3a329342cbe req-22c3007d-5e0f-473a-b06f-3739035c15b4 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 14:22:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.582s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] <== connect_volume: return (1584ms) {'type': 'block', 'scsi_wwn': '23636383233303838', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636383233303838', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'flavor' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:22:26 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:26 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:22:26 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:26 user nova-compute[75326]:   <serial>b2f0543f-9bef-4190-afa4-4eb03ac51e2a</serial>
Dec 06 14:22:26 user nova-compute[75326]: </disk>
Dec 06 14:22:26 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:bc:0c:f6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0137e7f7-4051-4064-b008-2cf4c8d4b9a0 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.447s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:22:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance spawned successfully.
Dec 06 14:22:27 user nova-compute[75326]: INFO nova.compute.manager [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Unrescuing
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.network.neutron [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:27 user nova-compute[75326]: WARNING nova.compute.manager [req-7bb670d8-5d6b-4b2f-a481-cb1620612f39 req-6733ee43-4cd9-49cc-86b2-b3221ad1297b service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 14:22:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:22:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9f06f75c-3e9f-4202-ab85-ba81e2e28dca tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.672s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:28 user nova-compute[75326]: INFO nova.compute.manager [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Rescuing
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG nova.network.neutron [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG nova.objects.instance [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'flavor' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:28 user nova-compute[75326]: WARNING nova.compute.manager [req-14fd0a8f-485f-45fc-a197-69e5a4c62835 req-45801f15-228e-4466-9464-8f1bc44612cd service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:22:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance destroyed successfully.
Dec 06 14:22:29 user nova-compute[75326]: DEBUG nova.network.neutron [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:30 user nova-compute[75326]: WARNING nova.compute.manager [req-03fb5a83-0830-4731-8c1a-1ef01476aa91 req-0ce253f8-f5e9-47f6-a185-f34a7ae2c774 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:30 user nova-compute[75326]: WARNING nova.compute.manager [req-61a38760-88bf-45dc-94c4-e8ea29e2b04c req-69b351c5-9fe3-41e4-8b93-f0fef73e5c7f service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance destroyed successfully.
Dec 06 14:22:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Attempting rescue
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:22:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Creating image(s)
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.355s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue" returned: 0 in 0.079s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.443s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'migration_context' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.base [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<90182363-4e9a-47be-93da-9dc41de98d4d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start _get_guest_xml network_info=[{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:bc:0c:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.base [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<90182363-4e9a-47be-93da-9dc41de98d4d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'numa_topology' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.base [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<90182363-4e9a-47be-93da-9dc41de98d4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:31 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:31 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.base [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<90182363-4e9a-47be-93da-9dc41de98d4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-179122323',display_name='tempest-ServerRescueNegativeTestJSON-server-179122323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-179122323',id=30,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDo4KtQFM7EcVVHt7y/hycZVjZUXQlwTsbBRR7uN2iZEHpsd8nONHCpP6FlDhIZnE9umGWZdGhAgSmo2hmSWtXZ3C+aD4PJwQzZZfdqqGLLYWElfJjHkya3UCo2nUVktLg==',key_name='tempest-keypair-1954013525',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-hwfmt608',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='779267c6564b43c293a1025a9c575b13',uuid=90182363-4e9a-47be-93da-9dc41de98d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:bc:0c:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "vif_mac": "fa:16:3e:bc:0c:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.instance [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'pci_devices' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.objects.base [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Object Instance<90182363-4e9a-47be-93da-9dc41de98d4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:22:31 user nova-compute[75326]:   <uuid>90182363-4e9a-47be-93da-9dc41de98d4d</uuid>
Dec 06 14:22:31 user nova-compute[75326]:   <name>instance-0000001e</name>
Dec 06 14:22:31 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:22:31 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:22:31 user nova-compute[75326]:   <metadata>
Dec 06 14:22:31 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:22:31 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-179122323</nova:name>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:22:31</nova:creationTime>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:22:31 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:22:31 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:owner>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:user uuid="779267c6564b43c293a1025a9c575b13">tempest-ServerRescueNegativeTestJSON-1889348723-project-member</nova:user>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:project uuid="86cdbc282e0a4495b38e0383600b8363">tempest-ServerRescueNegativeTestJSON-1889348723</nova:project>
Dec 06 14:22:31 user nova-compute[75326]:       </nova:owner>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:22:31 user nova-compute[75326]:       <nova:ports>
Dec 06 14:22:31 user nova-compute[75326]:         <nova:port uuid="bfaffc42-371b-4ebb-8216-65f90d996612">
Dec 06 14:22:31 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:22:31 user nova-compute[75326]:         </nova:port>
Dec 06 14:22:31 user nova-compute[75326]:       </nova:ports>
Dec 06 14:22:31 user nova-compute[75326]:     </nova:instance>
Dec 06 14:22:31 user nova-compute[75326]:   </metadata>
Dec 06 14:22:31 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:22:31 user nova-compute[75326]:     <system>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="serial">90182363-4e9a-47be-93da-9dc41de98d4d</entry>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="uuid">90182363-4e9a-47be-93da-9dc41de98d4d</entry>
Dec 06 14:22:31 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:22:31 user nova-compute[75326]:     </system>
Dec 06 14:22:31 user nova-compute[75326]:   </sysinfo>
Dec 06 14:22:31 user nova-compute[75326]:   <os>
Dec 06 14:22:31 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:22:31 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:22:31 user nova-compute[75326]:   </os>
Dec 06 14:22:31 user nova-compute[75326]:   <features>
Dec 06 14:22:31 user nova-compute[75326]:     <acpi/>
Dec 06 14:22:31 user nova-compute[75326]:     <apic/>
Dec 06 14:22:31 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:22:31 user nova-compute[75326]:   </features>
Dec 06 14:22:31 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:22:31 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:22:31 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:22:31 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:22:31 user nova-compute[75326]:   </clock>
Dec 06 14:22:31 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:22:31 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:22:31 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:22:31 user nova-compute[75326]:   </cpu>
Dec 06 14:22:31 user nova-compute[75326]:   <devices>
Dec 06 14:22:31 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:22:31 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:22:31 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue"/>
Dec 06 14:22:31 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:22:31 user nova-compute[75326]:     </disk>
Dec 06 14:22:31 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:22:31 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:22:31 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk"/>
Dec 06 14:22:31 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:22:31 user nova-compute[75326]:     </disk>
Dec 06 14:22:31 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:22:31 user nova-compute[75326]:       <mac address="fa:16:3e:bc:0c:f6"/>
Dec 06 14:22:31 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:31 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:22:31 user nova-compute[75326]:       <target dev="tapbfaffc42-37"/>
Dec 06 14:22:31 user nova-compute[75326]:     </interface>
Dec 06 14:22:31 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:22:31 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/console.log" append="off"/>
Dec 06 14:22:31 user nova-compute[75326]:     </serial>
Dec 06 14:22:31 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:22:31 user nova-compute[75326]:     <video>
Dec 06 14:22:31 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:31 user nova-compute[75326]:     </video>
Dec 06 14:22:31 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:22:31 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:22:31 user nova-compute[75326]:     </rng>
Dec 06 14:22:31 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:22:31 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:22:31 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:22:31 user nova-compute[75326]:     </memballoon>
Dec 06 14:22:31 user nova-compute[75326]:   </devices>
Dec 06 14:22:31 user nova-compute[75326]: </domain>
Dec 06 14:22:31 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:22:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance destroyed successfully.
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] No VIF found with MAC fa:16:3e:bc:0c:f6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing instance network info cache due to event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:32 user nova-compute[75326]: WARNING nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:32 user nova-compute[75326]: WARNING nova.compute.manager [req-bfaae1ba-1bb6-43cf-bb4d-e314455519d7 req-76551395-05b7-4acc-81d3-4ee73db30374 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updated VIF entry in instance network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing instance network info cache due to event network-changed-2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquired lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Refreshing network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updated VIF entry in instance network info cache for port 2954ec2e-e2ea-400c-8b68-79218917bc75. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.network.neutron [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [{"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Releasing lock "refresh_cache-2ccb172c-0758-42c4-ae72-7c115a8c36e5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING nova.compute.manager [req-0910d643-1698-4f3b-a9a3-a5270b279549 req-ea1c2fe1-15c2-409f-bb68-a7d67c6ba4fa service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onuhUbMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:33 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:33 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a41ea-ec2c-4910-890b-cfa7399f9163]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:22:33 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac6af7-cab8-4f3f-ae0b-eeaf508779d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07] added
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656d3d5-f61b-44ce-85e9-1f2c9d7f465f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[da116ec8-3280-4c80-afb3-5fdc20edca0b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onuhUbMI {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onuhUbMI" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a74564c-7d56-4798-8834-4e5d2b2f21ab]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'onuhUbMI'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ee6dca-cfc2-4e0d-9038-afc5f13f2b1d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d86bf-ed63-4fc6-8eb4-e634b9e936e0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35856ed8-b391-41b0-86de-d9d767e3463f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260]
Dec 06 14:22:34 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d93be-e293-48be-95ac-a91c5680156c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae7bad-a389-4a9d-91a0-5c35d5d14aa2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:34 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c6995-d5b8-434d-a3bc-49ee185c7d77]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onuhUbMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:34 user nova-compute[75326]: WARNING nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:34 user nova-compute[75326]: WARNING nova.compute.manager [req-a4088485-670d-4449-99c6-1152b9d1c844 req-7abfb3c5-2c90-4f0f-adb2-55b45a91eed0 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state active and task_state rescuing.
Dec 06 14:22:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23139346466306634', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139346466306634', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-354a33d7-ee05-4b53-81aa-3530c2ac3bf6 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:22:35 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:35 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:22:35 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:35 user nova-compute[75326]:   <serial>8e36dee8-3b21-471b-bfb1-28d54cc08a07</serial>
Dec 06 14:22:35 user nova-compute[75326]: </disk>
Dec 06 14:22:35 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] No VIF found with MAC fa:16:3e:cc:6d:9e, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16781655-4dc3-4fd6-9825-4c14141c726e tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.967s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-de30b102-8881-44eb-b113-0768885ae231 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:22:36 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:37 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:37 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13eaeb4-ddda-4419-b147-937227e8a1af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:22:37 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a9ed97-354e-4f70-abbf-5b180d0f7393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5] added
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022e194-ce55-462c-b3eb-1caf767d1023]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f45669-c57e-43b0-8199-5498d722fa46]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgQnGawY {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgQnGawY" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90214ee7-f15c-41bf-b51a-56f5b2fe967c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FgQnGawY'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c49c2e-ca80-40da-82a7-2289d79a4bed]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2247ef-410e-4f85-bdb0-9a4108c58d50]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ee68a-8c88-4e61-bc3f-9ea75a1657b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]
Dec 06 14:22:37 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897777a-5723-4db5-b6c9-9bfba2af64ff]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6da0469-cd2d-4681-9c66-b918000671d1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:37 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[263bbf08-36b2-4863-95f8-0db04dc0b9ae]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:37 user nova-compute[75326]: INFO nova.compute.manager [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Detaching volume 8e36dee8-3b21-471b-bfb1-28d54cc08a07
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:38 user nova-compute[75326]: INFO nova.virt.block_device [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Attempting to driver detach volume 8e36dee8-3b21-471b-bfb1-28d54cc08a07 from mountpoint /dev/vdb
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Attempting to detach device vdb from instance d1956e9c-87a4-48b8-9413-ef2d701893a0 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:22:38 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:38 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:22:38 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:38 user nova-compute[75326]:   <serial>8e36dee8-3b21-471b-bfb1-28d54cc08a07</serial>
Dec 06 14:22:38 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:22:38 user nova-compute[75326]: </disk>
Dec 06 14:22:38 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:22:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully detached device vdb from instance d1956e9c-87a4-48b8-9413-ef2d701893a0 from the persistent domain config.
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1956e9c-87a4-48b8-9413-ef2d701893a0 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:22:38 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:38 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:22:38 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:38 user nova-compute[75326]:   <serial>8e36dee8-3b21-471b-bfb1-28d54cc08a07</serial>
Dec 06 14:22:38 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:22:38 user nova-compute[75326]: </disk>
Dec 06 14:22:38 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26234393761326262', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234393761326262', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'flavor' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:22:38 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:38 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:22:38 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:38 user nova-compute[75326]:   <serial>2056882b-3c26-427d-b8bf-ae4a6376e5b5</serial>
Dec 06 14:22:38 user nova-compute[75326]: </disk>
Dec 06 14:22:38 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:06:bb:07, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-512f2c83-2e7b-4a6e-b776-b922a4abe2da tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.881s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:41 user nova-compute[75326]: INFO nova.compute.manager [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Rebuilding instance
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:41 user nova-compute[75326]: WARNING nova.compute.manager [req-d9d0c548-5191-41cb-bd21-42e10f7d17d6 req-69779bec-db5d-4559-94bc-49bdce24ef09 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state active and task_state rebuilding.
Dec 06 14:22:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance destroyed successfully.
Dec 06 14:22:42 user nova-compute[75326]: INFO nova.compute.manager [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Detaching volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: INFO nova.virt.block_device [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attempting to driver detach volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5 from mountpoint /dev/vdb
Dec 06 14:22:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Attempting to detach device vdb from instance 8f420a26-49d6-474d-8c32-750e9167564e from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:22:42 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:42 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:22:42 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:22:42 user nova-compute[75326]:   <serial>2056882b-3c26-427d-b8bf-ae4a6376e5b5</serial>
Dec 06 14:22:42 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:22:42 user nova-compute[75326]: </disk>
Dec 06 14:22:42 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:22:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully detached device vdb from instance 8f420a26-49d6-474d-8c32-750e9167564e from the persistent domain config.
Dec 06 14:22:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94235b9-9253-4dbe-bee9-f64f14f88bb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:22:42 user nova-compute[75326]: No targets found.
Dec 06 14:22:42 user nova-compute[75326]: iSNS:
Dec 06 14:22:42 user nova-compute[75326]: No targets found.
Dec 06 14:22:42 user nova-compute[75326]: STATIC:
Dec 06 14:22:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07
Dec 06 14:22:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:22:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:22:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:22:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:42 user nova-compute[75326]: FIRMWARE:
Dec 06 14:22:42 user nova-compute[75326]: No targets found.
Dec 06 14:22:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:22:42 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:22:42 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4abd6a-1a82-41be-b078-8ff8d89b7b7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c41e9-aafc-41b1-abdf-efa449bce40f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:42 user nova-compute[75326]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44edfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19acc53-5a56-402f-a14c-c31f6213e776]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682513c-60a2-4406-85f5-8fd2b39ba64f]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882a1f5-4cc7-4074-9eb2-33af9360749c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50b707d-6ed7-425b-9132-0fec038a91a9]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b62dda-1453-4d7d-b0d5-90c8d47ab1d0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbdfa71-3c76-42ad-b89a-49d37ca6e524]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]
Dec 06 14:22:43 user nova-compute[75326]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3dda2-e842-4362-aba3-971323912fd0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== disconnect_volume: return (500ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:44 user nova-compute[75326]: WARNING nova.compute.manager [req-2c4c1a3d-2910-4f98-a0bf-3ff13824dc52 req-76b88b2a-5d8e-4a46-87aa-51e97310705e service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state active and task_state rebuilding.
Dec 06 14:22:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7761MB free_disk=25.006439208984375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance d1956e9c-87a4-48b8-9413-ef2d701893a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance aae09742-d2f6-4291-bd41-0337df3ce9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c06e361b-368a-422a-a62c-d92bc09f0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:22:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance destroyed successfully.
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-ServerActionsTestOtherA-server-72701268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a526e1-08, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=227ac366-619b-460c-b185-b594bd73dbda) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:44 user nova-compute[75326]: INFO os_vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08')
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:44 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b317a-2a1e-42a6-8698-dbfc86ddb4ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:22:44 user nova-compute[75326]: No targets found.
Dec 06 14:22:44 user nova-compute[75326]: iSNS:
Dec 06 14:22:44 user nova-compute[75326]: No targets found.
Dec 06 14:22:44 user nova-compute[75326]: STATIC:
Dec 06 14:22:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07
Dec 06 14:22:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:22:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:44 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:22:44 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:44 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:44 user nova-compute[75326]: FIRMWARE:
Dec 06 14:22:44 user nova-compute[75326]: No targets found.
Dec 06 14:22:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:22:44 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:22:44 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e74d2-fdb6-42f5-af4e-141b19c7c213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc57fd7-6408-40fb-b60d-32e1bc94e2ae]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:44 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:44 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:44 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:44 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:44 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc2d5f30>, {}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Disconnecting from: [] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== disconnect_volume: return (95ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:22:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Deleting instance files /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e_del
Dec 06 14:22:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Deletion of /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e_del complete
Dec 06 14:22:44 user nova-compute[75326]: INFO nova.virt.block_device [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Booting with volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5 at /dev/vdb
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.utils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168b440-11cf-4e82-b8eb-eeaa71a864b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.783s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ed604-fa81-4c83-9ae9-e68d667580e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[931b6a7e-ad79-4564-ae2c-ef4fa8db597d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d021fd0d-709d-45e4-b5c5-6ae552ea3c74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:22:44 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:22:44 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d0a9c-31df-4c43-89c6-ef843a138593]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG os_brick.utils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:44 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating existing volume attachment record: c947f187-b0d3-48dc-9443-f163eb244275 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:45 user nova-compute[75326]: WARNING nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid c06e361b-368a-422a-a62c-d92bc09f0585 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: INFO nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:47 user nova-compute[75326]: INFO nova.compute.manager [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Terminating instance
Dec 06 14:22:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c7b5872-0aa3-4b65-8474-8f0eefcbedff req-6948eff4-c541-4c65-b84b-e53b3fbc6511 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-unplugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Instance destroyed successfully.
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.objects.instance [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'resources' on Instance uuid 7626a81f-f1bc-4aef-be81-b5979fc9bbcb {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843579329',display_name='tempest-TestMinimumBasicScenario-server-843579329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843579329',id=27,image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWtIRdbjwyZDjMVAcrGZKn8VdBxnOM9MHZaN5FD/UvMlm6mER//kyzRNTDAuZZY4L3XZD//qQIa+ZkAxXN8nzK5EWb/igQf18i4IO/TV/aHLRivClSyBOT3OwZ3VKpeoA==',key_name='tempest-TestMinimumBasicScenario-386394282',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-5ggad721',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='888a41b0-1feb-4344-b96d-971dc84333e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:20:05Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=7626a81f-f1bc-4aef-be81-b5979fc9bbcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "address": "fa:16:3e:97:ea:aa", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef51fec1-2b", "ovs_interfaceid": "ef51fec1-2bd2-4742-bbb6-8c54c05e06bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG os_vif [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef51fec1-2b, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49dc8d7b-5f4f-46a3-b0b7-859c266bd9ee) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:48 user nova-compute[75326]: INFO os_vif [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef51fec1-2b')
Dec 06 14:22:48 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Deleting instance files /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb_del
Dec 06 14:22:48 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Deletion of /opt/stack/data/nova/instances/7626a81f-f1bc-4aef-be81-b5979fc9bbcb_del complete
Dec 06 14:22:48 user nova-compute[75326]: INFO nova.compute.manager [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 06 14:22:48 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:22:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:49 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Took 0.63 seconds to deallocate network for instance.
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-42f6d20e-79ac-4433-9714-2119809b227a req-c299747e-6d30-4e84-9799-6b06dda6a336 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-deleted-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:49 user nova-compute[75326]: INFO nova.compute.manager [req-42f6d20e-79ac-4433-9714-2119809b227a req-c299747e-6d30-4e84-9799-6b06dda6a336 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Neutron deleted interface ef51fec1-2bd2-4742-bbb6-8c54c05e06bd; detaching it from the instance and deleting it from the info cache
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-42f6d20e-79ac-4433-9714-2119809b227a req-c299747e-6d30-4e84-9799-6b06dda6a336 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-42f6d20e-79ac-4433-9714-2119809b227a req-c299747e-6d30-4e84-9799-6b06dda6a336 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Detach interface failed, port_id=ef51fec1-2bd2-4742-bbb6-8c54c05e06bd, reason: Instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:49 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Deleted allocations for instance 7626a81f-f1bc-4aef-be81-b5979fc9bbcb
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-00dd214d-9148-4871-9c1d-4e8dff0eb071 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] Acquiring lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] Lock "7626a81f-f1bc-4aef-be81-b5979fc9bbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] No waiting events found dispatching network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:22:49 user nova-compute[75326]: WARNING nova.compute.manager [req-4383dd3a-7b36-436e-9728-f94559d6e33e req-978ba05c-8016-4357-91d1-fd1d6187d4d1 service nova] [instance: 7626a81f-f1bc-4aef-be81-b5979fc9bbcb] Received unexpected event network-vif-plugged-ef51fec1-2bd2-4742-bbb6-8c54c05e06bd for instance with vm_state deleted and task_state None.
Dec 06 14:22:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:22:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Creating image(s)
Dec 06 14:22:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk 1073741824" returned: 0 in 0.053s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Cannot resize image /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Ensure instance console log exists: /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start _get_guest_xml network_info=[{"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c947f187-b0d3-48dc-9443-f163eb244275', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f420a26-49d6-474d-8c32-750e9167564e', 'attached_at': '', 'detached_at': '', 'volume_id': '2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'serial': '2056882b-3c26-427d-b8bf-ae4a6376e5b5'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:22:56 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 14:22:56 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:56 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:56 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:56 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[172bd93c-6a36-4132-95fb-27b406b250a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:22:56 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb6560-2a75-481e-aac4-8f538bf39144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5] added
Dec 06 14:22:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a15830-21f8-4e0e-8877-f3c74b9389a9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38154af-597e-4913-9c61-b869722b691c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgQnGawY {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgQnGawY" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17355de3-5827-49f3-b57a-a77d3f92cbf1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FgQnGawY'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a4eda-74f0-4054-849c-fd7a06f209ff]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24698d-5e0b-4e33-8126-926807981603]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:56 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:56 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:56 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:56 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef2650-d689-4da4-98fd-0e1f97ad2721]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]
Dec 06 14:22:57 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:57 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f981e00-109c-494c-9739-779ba9a01ccc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1f6bd-9e85-4021-838b-a683edeefc1f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:57 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:57 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:57 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[18041762-196a-486b-8123-19425aa44e55]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:22:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26234393761326262', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234393761326262', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-ServerActionsTestOtherA-server-72701268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:22:58 user nova-compute[75326]:   <uuid>8f420a26-49d6-474d-8c32-750e9167564e</uuid>
Dec 06 14:22:58 user nova-compute[75326]:   <name>instance-00000020</name>
Dec 06 14:22:58 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:22:58 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:22:58 user nova-compute[75326]:   <metadata>
Dec 06 14:22:58 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:22:58 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherA-server-72701268</nova:name>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:22:56</nova:creationTime>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:22:58 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:22:58 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:owner>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:user uuid="584d6786de6449e7b07e35ca2a0a2291">tempest-ServerActionsTestOtherA-1568176033-project-member</nova:user>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:project uuid="fcea056f8f4348118fce811a5b38bbe3">tempest-ServerActionsTestOtherA-1568176033</nova:project>
Dec 06 14:22:58 user nova-compute[75326]:       </nova:owner>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:22:58 user nova-compute[75326]:       <nova:ports>
Dec 06 14:22:58 user nova-compute[75326]:         <nova:port uuid="c2a526e1-0870-43c1-8577-3359acb2102a">
Dec 06 14:22:58 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:22:58 user nova-compute[75326]:         </nova:port>
Dec 06 14:22:58 user nova-compute[75326]:       </nova:ports>
Dec 06 14:22:58 user nova-compute[75326]:     </nova:instance>
Dec 06 14:22:58 user nova-compute[75326]:   </metadata>
Dec 06 14:22:58 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:22:58 user nova-compute[75326]:     <system>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="serial">8f420a26-49d6-474d-8c32-750e9167564e</entry>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="uuid">8f420a26-49d6-474d-8c32-750e9167564e</entry>
Dec 06 14:22:58 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:22:58 user nova-compute[75326]:     </system>
Dec 06 14:22:58 user nova-compute[75326]:   </sysinfo>
Dec 06 14:22:58 user nova-compute[75326]:   <os>
Dec 06 14:22:58 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:22:58 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:22:58 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:22:58 user nova-compute[75326]:   </os>
Dec 06 14:22:58 user nova-compute[75326]:   <features>
Dec 06 14:22:58 user nova-compute[75326]:     <acpi/>
Dec 06 14:22:58 user nova-compute[75326]:     <apic/>
Dec 06 14:22:58 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:22:58 user nova-compute[75326]:   </features>
Dec 06 14:22:58 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:22:58 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:22:58 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:22:58 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:22:58 user nova-compute[75326]:   </clock>
Dec 06 14:22:58 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:22:58 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:22:58 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:22:58 user nova-compute[75326]:   </cpu>
Dec 06 14:22:58 user nova-compute[75326]:   <devices>
Dec 06 14:22:58 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:22:58 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:22:58 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk"/>
Dec 06 14:22:58 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:22:58 user nova-compute[75326]:     </disk>
Dec 06 14:22:58 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:22:58 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:22:58 user nova-compute[75326]:       <source dev="/dev/sde"/>
Dec 06 14:22:58 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:22:58 user nova-compute[75326]:       <serial>2056882b-3c26-427d-b8bf-ae4a6376e5b5</serial>
Dec 06 14:22:58 user nova-compute[75326]:     </disk>
Dec 06 14:22:58 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:22:58 user nova-compute[75326]:       <mac address="fa:16:3e:06:bb:07"/>
Dec 06 14:22:58 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:58 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:22:58 user nova-compute[75326]:       <target dev="tapc2a526e1-08"/>
Dec 06 14:22:58 user nova-compute[75326]:     </interface>
Dec 06 14:22:58 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:22:58 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/console.log" append="off"/>
Dec 06 14:22:58 user nova-compute[75326]:     </serial>
Dec 06 14:22:58 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:22:58 user nova-compute[75326]:     <video>
Dec 06 14:22:58 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:22:58 user nova-compute[75326]:     </video>
Dec 06 14:22:58 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:22:58 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:22:58 user nova-compute[75326]:     </rng>
Dec 06 14:22:58 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:22:58 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:22:58 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:22:58 user nova-compute[75326]:     </memballoon>
Dec 06 14:22:58 user nova-compute[75326]:   </devices>
Dec 06 14:22:58 user nova-compute[75326]: </domain>
Dec 06 14:22:58 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-ServerActionsTestOtherA-server-72701268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4435df09-20d5-5ea7-9bd5-49ba95b95f53', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a526e1-08, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a526e1-08, col_values=(('qos', UUID('a0b7c002-5243-4b44-9cff-f6ed9a454aed')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a526e1-08, col_values=(('external_ids', {'iface-id': 'c2a526e1-0870-43c1-8577-3359acb2102a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:bb:07', 'vm-uuid': '8f420a26-49d6-474d-8c32-750e9167564e'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: INFO os_vif [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08')
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:06:bb:07, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:22:58 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1956e9c-87a4-48b8-9413-ef2d701893a0 is timed out.
Dec 06 14:22:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully detached device vdb from instance d1956e9c-87a4-48b8-9413-ef2d701893a0 from the live domain config.
Dec 06 14:22:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onuhUbMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:22:58 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0b10c-c7eb-40a1-9f3e-c51b7d61339d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:22:58 user nova-compute[75326]: No targets found.
Dec 06 14:22:58 user nova-compute[75326]: iSNS:
Dec 06 14:22:58 user nova-compute[75326]: No targets found.
Dec 06 14:22:58 user nova-compute[75326]: STATIC:
Dec 06 14:22:58 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07
Dec 06 14:22:58 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:58 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:58 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:22:58 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:58 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:58 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:22:58 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:58 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:58 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:22:58 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:22:58 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:22:58 user nova-compute[75326]: FIRMWARE:
Dec 06 14:22:58 user nova-compute[75326]: No targets found.
Dec 06 14:22:58 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:22:58 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:22:58 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b189e4be-4dfe-414b-ae7c-4d2f9f1ad2b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a920a-9216-4182-b233-f1f63bb9fc32]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:58 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 (non-flash)
Dec 06 14:22:58 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:22:58 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44bf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e693971a-7610-41cd-bf05-2da07db9138a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69527dc7-7f3f-4406-8d9c-7cd90a450a1e]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[201bdedd-a37a-4167-98ec-bb658e5d8e8e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7858e935-11c2-4be5-8456-8565d8174df6]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d6660-3129-44bc-a1d2-b5594a43b5e4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2233a84e-79ab-4200-8abc-63d67127d1cf]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260]
Dec 06 14:22:59 user nova-compute[75326]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07, portal: 172.16.0.220,3260] successful.
Dec 06 14:22:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e36dee8-3b21-471b-bfb1-28d54cc08a07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6297ba1-a438-4f6e-a2be-9f3b80382112]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] <== disconnect_volume: return (398ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:22:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'flavor' on Instance uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:00 user nova-compute[75326]: WARNING nova.compute.manager [req-03d773b7-a8d0-4683-831a-e880229a5edc req-ca71ddcb-a616-4762-869f-e8b5270afab5 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state active and task_state rebuild_spawning.
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ab9e3935-79fc-4f96-b093-687927dd420c tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.113s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.728s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:23:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance spawned successfully.
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:02 user nova-compute[75326]: WARNING nova.compute.manager [req-e046386f-6b11-45dd-8dfc-8d34746767bc req-39a052c5-99ce-4c0e-a7e3-9d1da45ea437 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state active and task_state rebuild_spawning.
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75326) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:02 user nova-compute[75326]: INFO nova.compute.manager [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Detaching volume eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:23:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f9354501-8529-4b35-9ff6-72ecf9cf9865 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:02 user nova-compute[75326]: INFO nova.virt.block_device [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Attempting to driver detach volume eeb03607-4902-46f7-8a27-420222cbbefd from mountpoint /dev/vdb
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Attempting to detach device vdb from instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:23:02 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:23:02 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:23:02 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:23:02 user nova-compute[75326]:   <serial>eeb03607-4902-46f7-8a27-420222cbbefd</serial>
Dec 06 14:23:02 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:23:02 user nova-compute[75326]: </disk>
Dec 06 14:23:02 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:23:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Successfully detached device vdb from instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 from the persistent domain config.
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:23:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:23:02 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:23:02 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:23:02 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:23:02 user nova-compute[75326]:   <serial>eeb03607-4902-46f7-8a27-420222cbbefd</serial>
Dec 06 14:23:02 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:23:02 user nova-compute[75326]: </disk>
Dec 06 14:23:02 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:23:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:23:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:23:13 user nova-compute[75326]: INFO nova.compute.claims [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Claim successful on node user
Dec 06 14:23:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:23:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:23:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.policy [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f383064f7aad4c1e920149c5ec072c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618552d8f75d49e39a2ebdf7c8724e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:23:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Creating image(s)
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "/opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "/opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "/opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk 1073741824" returned: 0 in 0.059s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Successfully created port: f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:23:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Cannot resize image /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Ensure instance console log exists: /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Successfully updated port: f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquired lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-changed-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Refreshing instance network info cache due to event network-changed-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] Acquiring lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating instance_info_cache with network_info: [{"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Releasing lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Instance network_info: |[{"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] Acquired lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.neutron [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Refreshing network info cache for port f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Start _get_guest_xml network_info=[{"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:23:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2134674300',display_name='tempest-VolumesSnapshotTestJSON-instance-2134674300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2134674300',id=34,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5K6NsbaBo10afYuBvRo4ZPSAWTdnyt5h9H2qP4cz7lrPmD1sF788DamoAAptcYAxfjyDa9EkPpIRBbtwMulO+19ABGOKFTXYlLpVj2Hm8IZgYo6O7yO0u78vptvBF3lw==',key_name='tempest-keypair-363721430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-zg7rl17d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=572d7e24-62ec-4fd8-8edf-d77615e4cf1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.objects.instance [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'pci_devices' on Instance uuid 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:23:15 user nova-compute[75326]:   <uuid>572d7e24-62ec-4fd8-8edf-d77615e4cf1b</uuid>
Dec 06 14:23:15 user nova-compute[75326]:   <name>instance-00000022</name>
Dec 06 14:23:15 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:23:15 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:23:15 user nova-compute[75326]:   <metadata>
Dec 06 14:23:15 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:23:15 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2134674300</nova:name>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:23:15</nova:creationTime>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:23:15 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:23:15 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:owner>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:user uuid="f383064f7aad4c1e920149c5ec072c0f">tempest-VolumesSnapshotTestJSON-59172741-project-member</nova:user>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:project uuid="618552d8f75d49e39a2ebdf7c8724e88">tempest-VolumesSnapshotTestJSON-59172741</nova:project>
Dec 06 14:23:15 user nova-compute[75326]:       </nova:owner>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:23:15 user nova-compute[75326]:       <nova:ports>
Dec 06 14:23:15 user nova-compute[75326]:         <nova:port uuid="f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba">
Dec 06 14:23:15 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:23:15 user nova-compute[75326]:         </nova:port>
Dec 06 14:23:15 user nova-compute[75326]:       </nova:ports>
Dec 06 14:23:15 user nova-compute[75326]:     </nova:instance>
Dec 06 14:23:15 user nova-compute[75326]:   </metadata>
Dec 06 14:23:15 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:23:15 user nova-compute[75326]:     <system>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="serial">572d7e24-62ec-4fd8-8edf-d77615e4cf1b</entry>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="uuid">572d7e24-62ec-4fd8-8edf-d77615e4cf1b</entry>
Dec 06 14:23:15 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:23:15 user nova-compute[75326]:     </system>
Dec 06 14:23:15 user nova-compute[75326]:   </sysinfo>
Dec 06 14:23:15 user nova-compute[75326]:   <os>
Dec 06 14:23:15 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:23:15 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:23:15 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:23:15 user nova-compute[75326]:   </os>
Dec 06 14:23:15 user nova-compute[75326]:   <features>
Dec 06 14:23:15 user nova-compute[75326]:     <acpi/>
Dec 06 14:23:15 user nova-compute[75326]:     <apic/>
Dec 06 14:23:15 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:23:15 user nova-compute[75326]:   </features>
Dec 06 14:23:15 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:23:15 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:23:15 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:23:15 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:23:15 user nova-compute[75326]:   </clock>
Dec 06 14:23:15 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:23:15 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:23:15 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:23:15 user nova-compute[75326]:   </cpu>
Dec 06 14:23:15 user nova-compute[75326]:   <devices>
Dec 06 14:23:15 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:23:15 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:23:15 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk"/>
Dec 06 14:23:15 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:23:15 user nova-compute[75326]:     </disk>
Dec 06 14:23:15 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:23:15 user nova-compute[75326]:       <mac address="fa:16:3e:d4:6f:2c"/>
Dec 06 14:23:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:23:15 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:23:15 user nova-compute[75326]:       <target dev="tapf96ca970-4e"/>
Dec 06 14:23:15 user nova-compute[75326]:     </interface>
Dec 06 14:23:15 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:23:15 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/console.log" append="off"/>
Dec 06 14:23:15 user nova-compute[75326]:     </serial>
Dec 06 14:23:15 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:23:15 user nova-compute[75326]:     <video>
Dec 06 14:23:15 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:23:15 user nova-compute[75326]:     </video>
Dec 06 14:23:15 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:23:15 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:23:15 user nova-compute[75326]:     </rng>
Dec 06 14:23:15 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:23:15 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:23:15 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:23:15 user nova-compute[75326]:     </memballoon>
Dec 06 14:23:15 user nova-compute[75326]:   </devices>
Dec 06 14:23:15 user nova-compute[75326]: </domain>
Dec 06 14:23:15 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2134674300',display_name='tempest-VolumesSnapshotTestJSON-instance-2134674300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2134674300',id=34,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5K6NsbaBo10afYuBvRo4ZPSAWTdnyt5h9H2qP4cz7lrPmD1sF788DamoAAptcYAxfjyDa9EkPpIRBbtwMulO+19ABGOKFTXYlLpVj2Hm8IZgYo6O7yO0u78vptvBF3lw==',key_name='tempest-keypair-363721430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-zg7rl17d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=572d7e24-62ec-4fd8-8edf-d77615e4cf1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG os_vif [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee8fae27-b179-5723-85c3-56af4c0f014e', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf96ca970-4e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf96ca970-4e, col_values=(('qos', UUID('969b45ae-a6f4-473f-a01e-54061faa861f')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf96ca970-4e, col_values=(('external_ids', {'iface-id': 'f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:6f:2c', 'vm-uuid': '572d7e24-62ec-4fd8-8edf-d77615e4cf1b'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:15 user nova-compute[75326]: INFO os_vif [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e')
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:23:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No VIF found with MAC fa:16:3e:d4:6f:2c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:23:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updated VIF entry in instance network info cache for port f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:23:16 user nova-compute[75326]: DEBUG nova.network.neutron [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating instance_info_cache with network_info: [{"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42a1efda-ea47-41ff-bba0-f16a4a8ec93c req-5904a791-3615-43f3-a43c-2a7c6ce26e35 service nova] Releasing lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] No waiting events found dispatching network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:17 user nova-compute[75326]: WARNING nova.compute.manager [req-2e357f51-f0f1-41b8-852e-10364b96a7b3 req-03af2ace-9807-4381-ab96-d09b1e1caabc service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received unexpected event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba for instance with vm_state building and task_state spawning.
Dec 06 14:23:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:23:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Instance spawned successfully.
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:19 user nova-compute[75326]: INFO nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Took 5.55 seconds to spawn the instance on the hypervisor.
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] No waiting events found dispatching network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:19 user nova-compute[75326]: WARNING nova.compute.manager [req-37885b02-6cc2-4c20-af0c-2d5ad27a6dd1 req-851b1325-6721-4af1-bf36-46f4a7676390 service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received unexpected event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba for instance with vm_state building and task_state spawning.
Dec 06 14:23:19 user nova-compute[75326]: INFO nova.compute.manager [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Took 6.36 seconds to build instance.
Dec 06 14:23:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-d3cd77fa-c71c-44e3-b485-8b67fd35b699 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:23 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 is timed out.
Dec 06 14:23:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Successfully detached device vdb from instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 from the live domain config.
Dec 06 14:23:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGdaMVCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:23:23 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e12c6d9-3982-4632-a223-6205de07d6a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:23:23 user nova-compute[75326]: No targets found.
Dec 06 14:23:23 user nova-compute[75326]: iSNS:
Dec 06 14:23:23 user nova-compute[75326]: No targets found.
Dec 06 14:23:23 user nova-compute[75326]: STATIC:
Dec 06 14:23:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:23:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:23:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:23:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd
Dec 06 14:23:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:23:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:23:23 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:23:23 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:23:23 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:23:23 user nova-compute[75326]: FIRMWARE:
Dec 06 14:23:23 user nova-compute[75326]: No targets found.
Dec 06 14:23:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:23:23 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:23:23 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160f8c0-0d6c-4669-af24-04a6196dd855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e8d2a0-35c7-419c-89e4-9e8590d38db9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:23:23 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:23:23 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:23:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd (non-flash)
Dec 06 14:23:23 user nova-compute[75326]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:23:23 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:23:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb42f1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38596ac0-4998-471a-a00a-52871f815c23]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeeb241-f14c-4a0a-82ee-5b88823c5e19]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ab7f7-01eb-4d5a-9e6b-c9c6cc2a6aca]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2be8c-1a48-4dff-939b-4104f3a928e0]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a2a7c-ea00-48ac-ad39-7c18d8e8e69e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812ed9d-c85f-4002-b004-183d53314c88]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260]
Dec 06 14:23:23 user nova-compute[75326]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd, portal: 172.16.0.220,3260] successful.
Dec 06 14:23:23 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb03607-4902-46f7-8a27-420222cbbefd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dc2b13-a0bf-497e-b664-85faf9cada78]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] <== disconnect_volume: return (317ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:23:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'flavor' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5ec9a423-2f40-4569-8b8f-ddafcc0be521 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing instance network info cache due to event network-changed-a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] Acquiring lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] Acquired lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG nova.network.neutron [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Refreshing network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:28 user nova-compute[75326]: INFO nova.compute.manager [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Terminating instance
Dec 06 14:23:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.network.neutron [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updated VIF entry in instance network info cache for port a39e9b36-7082-40a8-8f1e-444c4b23ff47. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.network.neutron [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating instance_info_cache with network_info: [{"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-eccc566b-474f-4972-9d4c-4889a3f6e3b9 req-787b65ac-8d7e-470f-9cde-0a6e08c01935 service nova] Releasing lock "refresh_cache-d1956e9c-87a4-48b8-9413-ef2d701893a0" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Instance destroyed successfully.
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'resources' on Instance uuid d1956e9c-87a4-48b8-9413-ef2d701893a0 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1917057359',display_name='tempest-TestStampPattern-server-1917057359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1917057359',id=31,image_ref='6b478fb4-6ef5-4158-bd7d-3e42fd66c03e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-5f599j26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9',image_min_disk='1',image_min_ram='0',image_owner_id='c20585cba38541d88671fc0448e0c686',image_owner_project_name='tempest-TestStampPattern-690937075',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-690937075-project-member',image_user_id='60a9ed63f2b04f8cb9616a6394be48b9',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:20:35Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=d1956e9c-87a4-48b8-9413-ef2d701893a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "address": "fa:16:3e:cc:6d:9e", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39e9b36-70", "ovs_interfaceid": "a39e9b36-7082-40a8-8f1e-444c4b23ff47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG os_vif [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39e9b36-70, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f622cf09-811d-4ee3-a13e-771e6c94691b) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:29 user nova-compute[75326]: INFO os_vif [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=a39e9b36-7082-40a8-8f1e-444c4b23ff47,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39e9b36-70')
Dec 06 14:23:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Deleting instance files /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0_del
Dec 06 14:23:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Deletion of /opt/stack/data/nova/instances/d1956e9c-87a4-48b8-9413-ef2d701893a0_del complete
Dec 06 14:23:29 user nova-compute[75326]: INFO nova.compute.manager [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 06 14:23:29 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:23:29 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:30 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Took 0.46 seconds to deallocate network for instance.
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:30 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Deleted allocations for instance d1956e9c-87a4-48b8-9413-ef2d701893a0
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c1673afd-7c71-4f58-8cf9-754d836051e1 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-vif-unplugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] No waiting events found dispatching network-vif-unplugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:30 user nova-compute[75326]: WARNING nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received unexpected event network-vif-unplugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 for instance with vm_state deleted and task_state None.
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Acquiring lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] Lock "d1956e9c-87a4-48b8-9413-ef2d701893a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] No waiting events found dispatching network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:30 user nova-compute[75326]: WARNING nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received unexpected event network-vif-plugged-a39e9b36-7082-40a8-8f1e-444c4b23ff47 for instance with vm_state deleted and task_state None.
Dec 06 14:23:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f6fc5645-7e08-4a81-8c69-e3e1d6fe9092 req-c1abcade-01c5-4435-8804-4d7aa835ff7d service nova] [instance: d1956e9c-87a4-48b8-9413-ef2d701893a0] Received event network-vif-deleted-a39e9b36-7082-40a8-8f1e-444c4b23ff47 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:32 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=24.968185424804688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance aae09742-d2f6-4291-bd41-0337df3ce9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c06e361b-368a-422a-a62c-d92bc09f0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:23:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:23:42 user nova-compute[75326]: INFO nova.compute.claims [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Claim successful on node user
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:23:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.policy [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c053c2d147df4c959d5cffa31dc2490c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e022afe38348fd87bc8b16175e1f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:23:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Creating image(s)
Dec 06 14:23:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "/opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "/opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Successfully created port: 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.virt.images [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] 42db6404-9b71-460e-9d91-d0f264824ec5 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.part /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.part /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.converted" returned: 0 in 0.373s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Successfully updated port: 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.589s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing instance network info cache due to event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance network_info: |[{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04,backing_fmt=raw /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04,backing_fmt=raw /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk 1073741824" returned: 0 in 0.054s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "fcb7ce67250a9228989ed7f5d86139fcf0447f04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updated VIF entry in instance network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c409fbfa-33d4-438c-ad4a-ada1f7d1de1f req-993d4bbb-77e8-4e58-98fb-c8b623444a83 service nova] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Cannot resize image /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Ensure instance console log exists: /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Start _get_guest_xml network_info=[{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:23:39Z,direct_url=<?>,disk_format='qcow2',id=42db6404-9b71-460e-9d91-d0f264824ec5,min_disk=0,min_ram=0,name='tempest-scenario-img--1384488498',owner='44e022afe38348fd87bc8b16175e1f09',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:23:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '42db6404-9b71-460e-9d91-d0f264824ec5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:23:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:23:39Z,direct_url=<?>,disk_format='qcow2',id=42db6404-9b71-460e-9d91-d0f264824ec5,min_disk=0,min_ram=0,name='tempest-scenario-img--1384488498',owner='44e022afe38348fd87bc8b16175e1f09',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:23:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-539430336',display_name='tempest-TestMinimumBasicScenario-server-539430336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-539430336',id=35,image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHboxhgN8XKVoBi+OEwP8lCZidMKQJMgQC3txQKGMj65FkWfx9Hg8CSdICqUqhvZ7oqXsm/dD0HImU98Nk5tIuIMt2ePkDgiPJiLbQ1F/N9/v0ekNwKUrDXKO3wqaeGTYA==',key_name='tempest-TestMinimumBasicScenario-326950416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-x1i4eev4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:23:43Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=e7308382-95a1-4c2e-89e9-18462522bdd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'pci_devices' on Instance uuid e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:23:45 user nova-compute[75326]:   <uuid>e7308382-95a1-4c2e-89e9-18462522bdd5</uuid>
Dec 06 14:23:45 user nova-compute[75326]:   <name>instance-00000023</name>
Dec 06 14:23:45 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:23:45 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:23:45 user nova-compute[75326]:   <metadata>
Dec 06 14:23:45 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:23:45 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:name>tempest-TestMinimumBasicScenario-server-539430336</nova:name>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:23:45</nova:creationTime>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:23:45 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:23:45 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:owner>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:user uuid="c053c2d147df4c959d5cffa31dc2490c">tempest-TestMinimumBasicScenario-1988051507-project-member</nova:user>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:project uuid="44e022afe38348fd87bc8b16175e1f09">tempest-TestMinimumBasicScenario-1988051507</nova:project>
Dec 06 14:23:45 user nova-compute[75326]:       </nova:owner>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:root type="image" uuid="42db6404-9b71-460e-9d91-d0f264824ec5"/>
Dec 06 14:23:45 user nova-compute[75326]:       <nova:ports>
Dec 06 14:23:45 user nova-compute[75326]:         <nova:port uuid="9eb63748-c0e6-4646-a98d-da18447b0055">
Dec 06 14:23:45 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:23:45 user nova-compute[75326]:         </nova:port>
Dec 06 14:23:45 user nova-compute[75326]:       </nova:ports>
Dec 06 14:23:45 user nova-compute[75326]:     </nova:instance>
Dec 06 14:23:45 user nova-compute[75326]:   </metadata>
Dec 06 14:23:45 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:23:45 user nova-compute[75326]:     <system>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="serial">e7308382-95a1-4c2e-89e9-18462522bdd5</entry>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="uuid">e7308382-95a1-4c2e-89e9-18462522bdd5</entry>
Dec 06 14:23:45 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:23:45 user nova-compute[75326]:     </system>
Dec 06 14:23:45 user nova-compute[75326]:   </sysinfo>
Dec 06 14:23:45 user nova-compute[75326]:   <os>
Dec 06 14:23:45 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:23:45 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:23:45 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:23:45 user nova-compute[75326]:   </os>
Dec 06 14:23:45 user nova-compute[75326]:   <features>
Dec 06 14:23:45 user nova-compute[75326]:     <acpi/>
Dec 06 14:23:45 user nova-compute[75326]:     <apic/>
Dec 06 14:23:45 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:23:45 user nova-compute[75326]:   </features>
Dec 06 14:23:45 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:23:45 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:23:45 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:23:45 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:23:45 user nova-compute[75326]:   </clock>
Dec 06 14:23:45 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:23:45 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:23:45 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:23:45 user nova-compute[75326]:   </cpu>
Dec 06 14:23:45 user nova-compute[75326]:   <devices>
Dec 06 14:23:45 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:23:45 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:23:45 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk"/>
Dec 06 14:23:45 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:23:45 user nova-compute[75326]:     </disk>
Dec 06 14:23:45 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:23:45 user nova-compute[75326]:       <mac address="fa:16:3e:06:2e:94"/>
Dec 06 14:23:45 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:23:45 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:23:45 user nova-compute[75326]:       <target dev="tap9eb63748-c0"/>
Dec 06 14:23:45 user nova-compute[75326]:     </interface>
Dec 06 14:23:45 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:23:45 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/console.log" append="off"/>
Dec 06 14:23:45 user nova-compute[75326]:     </serial>
Dec 06 14:23:45 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:23:45 user nova-compute[75326]:     <video>
Dec 06 14:23:45 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:23:45 user nova-compute[75326]:     </video>
Dec 06 14:23:45 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:23:45 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:23:45 user nova-compute[75326]:     </rng>
Dec 06 14:23:45 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:23:45 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:23:45 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:23:45 user nova-compute[75326]:     </memballoon>
Dec 06 14:23:45 user nova-compute[75326]:   </devices>
Dec 06 14:23:45 user nova-compute[75326]: </domain>
Dec 06 14:23:45 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-539430336',display_name='tempest-TestMinimumBasicScenario-server-539430336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-539430336',id=35,image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHboxhgN8XKVoBi+OEwP8lCZidMKQJMgQC3txQKGMj65FkWfx9Hg8CSdICqUqhvZ7oqXsm/dD0HImU98Nk5tIuIMt2ePkDgiPJiLbQ1F/N9/v0ekNwKUrDXKO3wqaeGTYA==',key_name='tempest-TestMinimumBasicScenario-326950416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-x1i4eev4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:23:43Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=e7308382-95a1-4c2e-89e9-18462522bdd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG os_vif [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c43b9c7-0ede-581b-949a-cdfdcb9d0b22', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eb63748-c0, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eb63748-c0, col_values=(('qos', UUID('e54c36b7-7ae6-4db7-bea5-fa76b2248787')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eb63748-c0, col_values=(('external_ids', {'iface-id': '9eb63748-c0e6-4646-a98d-da18447b0055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:2e:94', 'vm-uuid': 'e7308382-95a1-4c2e-89e9-18462522bdd5'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:45 user nova-compute[75326]: INFO os_vif [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0')
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No VIF found with MAC fa:16:3e:06:2e:94, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:23:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:47 user nova-compute[75326]: WARNING nova.compute.manager [req-e504c155-29e9-434d-888e-e89c39c38ab6 req-d6814a5b-5b4f-41d5-a2d5-02ab74ce3894 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state building and task_state spawning.
Dec 06 14:23:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:23:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance spawned successfully.
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:23:49 user nova-compute[75326]: INFO nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Took 6.27 seconds to spawn the instance on the hypervisor.
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:49 user nova-compute[75326]: WARNING nova.compute.manager [req-3f71ccb9-f9fd-4d98-b5f8-db69aa714cc8 req-e77563dc-f804-4a67-a32c-5ccbcec8eec8 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state building and task_state spawning.
Dec 06 14:23:49 user nova-compute[75326]: INFO nova.compute.manager [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Took 7.29 seconds to build instance.
Dec 06 14:23:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f2a004be-ec9f-496c-bbbf-4ae6ed99753a tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.491s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:53 user nova-compute[75326]: INFO nova.compute.manager [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Terminating instance
Dec 06 14:23:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-55f7b3b0-5b2e-428f-94a7-6c23f53266d8 req-3693df22-e7ca-47ca-bd58-216c8785586c service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-unplugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:23:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Instance destroyed successfully.
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lazy-loading 'resources' on Instance uuid 2ccb172c-0758-42c4-ae72-7c115a8c36e5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-771152837',display_name='tempest-ServerStableDeviceRescueTest-server-771152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-771152837',id=22,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiRKZiuA0wOtFrfJuBFo/XVJP+icvnqrfNzzZ0LGCt5xq1Csi4Kz1+swPwoQCgVKrcf4eLJD6lbTz4j1R2FQIU82S+oXapz4JT0edBe2UPUhAudhHKpLHXoEGmCS4ijLg==',key_name='tempest-keypair-2036139810',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08132609a7b6464aa607ab2b5aa67eff',ramdisk_id='',reservation_id='r-gqnm3l0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1187090853',owner_user_name='tempest-ServerStableDeviceRescueTest-1187090853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:22:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d7e6b93568f45c5bb4d5f2c660cfbf6',uuid=2ccb172c-0758-42c4-ae72-7c115a8c36e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converting VIF {"id": "2954ec2e-e2ea-400c-8b68-79218917bc75", "address": "fa:16:3e:08:9e:30", "network": {"id": "8f119256-e58a-4a43-b666-5b689c61c399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-539222446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08132609a7b6464aa607ab2b5aa67eff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2954ec2e-e2", "ovs_interfaceid": "2954ec2e-e2ea-400c-8b68-79218917bc75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG os_vif [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2954ec2e-e2, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ebfc242-ec92-4013-8565-20b36093fdd2) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:23:54 user nova-compute[75326]: INFO os_vif [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:9e:30,bridge_name='br-int',has_traffic_filtering=True,id=2954ec2e-e2ea-400c-8b68-79218917bc75,network=Network(8f119256-e58a-4a43-b666-5b689c61c399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2954ec2e-e2')
Dec 06 14:23:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Deleting instance files /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5_del
Dec 06 14:23:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Deletion of /opt/stack/data/nova/instances/2ccb172c-0758-42c4-ae72-7c115a8c36e5_del complete
Dec 06 14:23:54 user nova-compute[75326]: INFO nova.compute.manager [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Took 1.08 seconds to destroy the instance on the hypervisor.
Dec 06 14:23:54 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:23:54 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:55 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Took 1.00 seconds to deallocate network for instance.
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-5c3c9f30-0b62-43e7-84c3-7e181963b197 req-5eaeb76b-606b-4812-ace1-66db36b292c0 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-deleted-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:55 user nova-compute[75326]: INFO nova.compute.manager [req-5c3c9f30-0b62-43e7-84c3-7e181963b197 req-5eaeb76b-606b-4812-ace1-66db36b292c0 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Neutron deleted interface 2954ec2e-e2ea-400c-8b68-79218917bc75; detaching it from the instance and deleting it from the info cache
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.network.neutron [req-5c3c9f30-0b62-43e7-84c3-7e181963b197 req-5eaeb76b-606b-4812-ace1-66db36b292c0 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-5c3c9f30-0b62-43e7-84c3-7e181963b197 req-5eaeb76b-606b-4812-ace1-66db36b292c0 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Detach interface failed, port_id=2954ec2e-e2ea-400c-8b68-79218917bc75, reason: Instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] Acquiring lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] No waiting events found dispatching network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:23:55 user nova-compute[75326]: WARNING nova.compute.manager [req-73f66dab-cb98-4037-9a7d-554bad943ec7 req-a7e003b6-e6a8-4ed6-b431-f82a435ee2e7 service nova] [instance: 2ccb172c-0758-42c4-ae72-7c115a8c36e5] Received unexpected event network-vif-plugged-2954ec2e-e2ea-400c-8b68-79218917bc75 for instance with vm_state deleted and task_state None.
Dec 06 14:23:55 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Deleted allocations for instance 2ccb172c-0758-42c4-ae72-7c115a8c36e5
Dec 06 14:23:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f73ba295-b072-4be8-a8c0-1c5ec70dd2f3 tempest-ServerStableDeviceRescueTest-1187090853 tempest-ServerStableDeviceRescueTest-1187090853-project-member] Lock "2ccb172c-0758-42c4-ae72-7c115a8c36e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:23:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:04 user nova-compute[75326]: INFO nova.compute.manager [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Terminating instance
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-f8242461-eb4c-458a-8960-356977631412 req-a721c8d2-eabf-487b-b37f-ce7e5e3b0fae service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-unplugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Instance destroyed successfully.
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lazy-loading 'resources' on Instance uuid aae09742-d2f6-4291-bd41-0337df3ce9c1 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1098097890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1098097890',id=28,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvA7c2M/dNfeZX/7DVkmjUtVFHsXll6qoNszwh/Ws48lSDFoMCbAYmQB78PXMLbrZ4Xf86khlAvf5S9iUTkCJs6lcoOi2Gx0DD9s8NwwDYYoCUrKTCpmCWIvaQGzlMXiA==',key_name='tempest-keypair-606551783',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7c14bbf4b604b6282ec7c5e925c2514',ramdisk_id='',reservation_id='r-gqnaket3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-82698496',owner_user_name='tempest-AttachVolumeShelveTestJSON-82698496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='921ceb47e4174eb0b5a47fe727d4a1d2',uuid=aae09742-d2f6-4291-bd41-0337df3ce9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converting VIF {"id": "b5ea5d62-6081-4079-b059-c45be12249c6", "address": "fa:16:3e:a7:f8:40", "network": {"id": "f3ed1086-3f9e-4234-a7a3-a83c061e6843", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-588120288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c14bbf4b604b6282ec7c5e925c2514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ea5d62-60", "ovs_interfaceid": "b5ea5d62-6081-4079-b059-c45be12249c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG os_vif [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5ea5d62-60, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b07d330f-810e-45ec-a85b-12777f6b19d2) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:24:04 user nova-compute[75326]: INFO os_vif [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=b5ea5d62-6081-4079-b059-c45be12249c6,network=Network(f3ed1086-3f9e-4234-a7a3-a83c061e6843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ea5d62-60')
Dec 06 14:24:04 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Deleting instance files /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1_del
Dec 06 14:24:04 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Deletion of /opt/stack/data/nova/instances/aae09742-d2f6-4291-bd41-0337df3ce9c1_del complete
Dec 06 14:24:04 user nova-compute[75326]: INFO nova.compute.manager [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 06 14:24:04 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:24:04 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:05 user nova-compute[75326]: INFO nova.compute.manager [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Terminating instance
Dec 06 14:24:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-unplugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-unplugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-f3afb7e6-6b76-471b-8cf5-d2de5a3d7e30 req-7b743ca0-1e52-4364-be74-19ef6c6a1c04 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-unplugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:05 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Took 1.01 seconds to deallocate network for instance.
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Instance destroyed successfully.
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lazy-loading 'resources' on Instance uuid c06e361b-368a-422a-a62c-d92bc09f0585 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2001634163',display_name='tempest-VolumesActionsTest-instance-2001634163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2001634163',id=33,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:22:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42606f35dde84948b771234dc36c558d',ramdisk_id='',reservation_id='r-pfgjg1lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-969285127',owner_user_name='tempest-VolumesActionsTest-969285127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:22:24Z,user_data=None,user_id='61037bed82704e35b06d34c6835dbcb1',uuid=c06e361b-368a-422a-a62c-d92bc09f0585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converting VIF {"id": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "address": "fa:16:3e:03:f0:ff", "network": {"id": "3c2bce5d-0b8b-402c-aa5f-87eebc9187f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1092237839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42606f35dde84948b771234dc36c558d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9592961c-72", "ovs_interfaceid": "9592961c-72c3-45c8-bfe4-79aefd4cd792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG os_vif [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9592961c-72, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a9ccbd9-7032-4b7f-967c-b89c6ff5a815) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: INFO os_vif [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f0:ff,bridge_name='br-int',has_traffic_filtering=True,id=9592961c-72c3-45c8-bfe4-79aefd4cd792,network=Network(3c2bce5d-0b8b-402c-aa5f-87eebc9187f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9592961c-72')
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Deleting instance files /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585_del
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Deletion of /opt/stack/data/nova/instances/c06e361b-368a-422a-a62c-d92bc09f0585_del complete
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.compute.manager [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Took 0.78 seconds to destroy the instance on the hypervisor.
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Deleted allocations for instance aae09742-d2f6-4291-bd41-0337df3ce9c1
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] Acquiring lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] No waiting events found dispatching network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:06 user nova-compute[75326]: WARNING nova.compute.manager [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received unexpected event network-vif-plugged-b5ea5d62-6081-4079-b059-c45be12249c6 for instance with vm_state deleted and task_state None.
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-97cf1f15-c7d2-4c7a-9b4f-e4c1ba742771 req-55694d7d-b461-443a-aec8-057a7554ca53 service nova] [instance: aae09742-d2f6-4291-bd41-0337df3ce9c1] Received event network-vif-deleted-b5ea5d62-6081-4079-b059-c45be12249c6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9ac85db0-3f13-4613-acc3-f44a7b6568c9 tempest-AttachVolumeShelveTestJSON-82698496 tempest-AttachVolumeShelveTestJSON-82698496-project-member] Lock "aae09742-d2f6-4291-bd41-0337df3ce9c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:06 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Took 0.48 seconds to deallocate network for instance.
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:07 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Deleted allocations for instance c06e361b-368a-422a-a62c-d92bc09f0585
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-46087a9b-fc5f-4d83-8465-362edf06f281 tempest-VolumesActionsTest-969285127 tempest-VolumesActionsTest-969285127-project-member] Lock "c06e361b-368a-422a-a62c-d92bc09f0585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:07 user nova-compute[75326]: WARNING nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received unexpected event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with vm_state deleted and task_state None.
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:07 user nova-compute[75326]: WARNING nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received unexpected event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with vm_state deleted and task_state None.
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Acquiring lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] Lock "c06e361b-368a-422a-a62c-d92bc09f0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] No waiting events found dispatching network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:07 user nova-compute[75326]: WARNING nova.compute.manager [req-74a1f6f3-a8de-44ee-b56d-624cf3b12be3 req-684d0247-6cc0-4ab0-af3d-a79111b0733f service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received unexpected event network-vif-plugged-9592961c-72c3-45c8-bfe4-79aefd4cd792 for instance with vm_state deleted and task_state None.
Dec 06 14:24:08 user nova-compute[75326]: DEBUG nova.compute.manager [req-72363cce-ef36-4d2d-90ab-8ef66c52acbe req-c5ef2803-7336-4c28-abaa-29ebbe9cf5e8 service nova] [instance: c06e361b-368a-422a-a62c-d92bc09f0585] Received event network-vif-deleted-9592961c-72c3-45c8-bfe4-79aefd4cd792 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:19 user nova-compute[75326]: INFO nova.compute.manager [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Unrescuing
Dec 06 14:24:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG nova.objects.instance [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'flavor' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:20 user nova-compute[75326]: WARNING nova.compute.manager [req-ee38024a-30d3-4f90-ad35-17cd6a899cd4 req-7a9f754c-877a-4837-9197-5fb0661d9bc2 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:24:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance destroyed successfully.
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:22 user nova-compute[75326]: WARNING nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:22 user nova-compute[75326]: WARNING nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:22 user nova-compute[75326]: WARNING nova.compute.manager [req-30b71d20-2cbf-49d3-afd9-949e05060b5f req-ea98750e-cbf5-4f59-8a12-5655c07463ca service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:24:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-aa84c584-dc38-480d-b106-8798f673d0bd tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:24:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.compute.manager [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing instance network info cache due to event network-changed-61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] Acquiring lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] Acquired lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Refreshing network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:31 user nova-compute[75326]: INFO nova.compute.manager [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Terminating instance
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updated VIF entry in instance network info cache for port 61d4b3a6-f21e-40c6-bc27-993e5ea837fd. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG nova.network.neutron [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [{"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-216c4628-4961-4bf1-bd81-3b68741b3dd9 req-d69ab987-7bcc-43f8-8e9c-0fbb587f1805 service nova] Releasing lock "refresh_cache-076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Instance destroyed successfully.
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lazy-loading 'resources' on Instance uuid 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1405228567',display_name='tempest-TestStampPattern-server-1405228567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1405228567',id=24,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzuQC9JskPI7+vAMvqDud7x4TKYCoz5l4q908ldHqso20XyaWqNCidJGcrLptBLSiwkCoMPEuW2gSnqXl5b+3BwvsiQxx2IGaVvf7ZzNbsAYdr29JvL2KzxmNs8FWfgeA==',key_name='tempest-TestStampPattern-680966689',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c20585cba38541d88671fc0448e0c686',ramdisk_id='',reservation_id='r-yoaaz0sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-690937075',owner_user_name='tempest-TestStampPattern-690937075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:20:24Z,user_data=None,user_id='60a9ed63f2b04f8cb9616a6394be48b9',uuid=076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converting VIF {"id": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "address": "fa:16:3e:48:0d:83", "network": {"id": "3fb3ad1a-36bf-47e7-a6f0-251679deb818", "bridge": "br-int", "label": "tempest-TestStampPattern-1495956932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c20585cba38541d88671fc0448e0c686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61d4b3a6-f2", "ovs_interfaceid": "61d4b3a6-f21e-40c6-bc27-993e5ea837fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG os_vif [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61d4b3a6-f2, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d294e40d-2647-4ed8-bf08-8cf8e658192a) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:24:32 user nova-compute[75326]: INFO os_vif [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0d:83,bridge_name='br-int',has_traffic_filtering=True,id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd,network=Network(3fb3ad1a-36bf-47e7-a6f0-251679deb818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61d4b3a6-f2')
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Deleting instance files /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9_del
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Deletion of /opt/stack/data/nova/instances/076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9_del complete
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.compute.manager [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 14:24:32 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae99ba59-7d03-4705-aeb0-ac51bc0c9f36 req-8f80efb2-a434-4865-a6a6-b6c70afbf4f3 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-vif-deleted-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.compute.manager [req-ae99ba59-7d03-4705-aeb0-ac51bc0c9f36 req-8f80efb2-a434-4865-a6a6-b6c70afbf4f3 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Neutron deleted interface 61d4b3a6-f21e-40c6-bc27-993e5ea837fd; detaching it from the instance and deleting it from the info cache
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.network.neutron [req-ae99ba59-7d03-4705-aeb0-ac51bc0c9f36 req-8f80efb2-a434-4865-a6a6-b6c70afbf4f3 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:24:32 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Took 0.46 seconds to deallocate network for instance.
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.compute.manager [req-ae99ba59-7d03-4705-aeb0-ac51bc0c9f36 req-8f80efb2-a434-4865-a6a6-b6c70afbf4f3 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Detach interface failed, port_id=61d4b3a6-f21e-40c6-bc27-993e5ea837fd, reason: Instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:24:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:33 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Deleted allocations for instance 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4bfd0364-71ac-43da-896b-c4ffafd2d265 tempest-TestStampPattern-690937075 tempest-TestStampPattern-690937075-project-member] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-vif-unplugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] No waiting events found dispatching network-vif-unplugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:33 user nova-compute[75326]: WARNING nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received unexpected event network-vif-unplugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd for instance with vm_state deleted and task_state None.
Dec 06 14:24:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Acquiring lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] Lock "076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:33 user nova-compute[75326]: DEBUG nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] No waiting events found dispatching network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:24:33 user nova-compute[75326]: WARNING nova.compute.manager [req-d37ae5d8-0e40-46ee-a292-9c08528619eb req-210e5220-6ef8-4279-8c3d-e57a4f150749 service nova] [instance: 076eb0a4-5a4f-49d7-8c2e-bec3880d2bc9] Received unexpected event network-vif-plugged-61d4b3a6-f21e-40c6-bc27-993e5ea837fd for instance with vm_state deleted and task_state None.
Dec 06 14:24:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:24:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:24:39 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:24:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.212711334228516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:24:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e7308382-95a1-4c2e-89e9-18462522bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:24:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:24:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:24:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-changed-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Refreshing instance network info cache due to event network-changed-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] Acquiring lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] Acquired lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Refreshing network info cache for port f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:04 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Ignoring supplied device name: /dev/vdb
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updated VIF entry in instance network info cache for port f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating instance_info_cache with network_info: [{"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-37815359-01b1-44a0-be89-f048cbf68f6b req-016878ca-c74a-49f2-b0cd-440a956b3cde service nova] Releasing lock "refresh_cache-572d7e24-62ec-4fd8-8edf-d77615e4cf1b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:05 user nova-compute[75326]: INFO nova.compute.manager [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Attaching volume ae7f5ab2-a111-499e-aaba-ab89493c7d84 to /dev/vdb
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.utils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87c87a4-290f-4cb3-ab46-9e582a6cfc6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54962e-e6db-4d2c-a533-9254c95fb005]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b22901-2191-45a6-8a47-212310d3edd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20ab1a-7e25-4e8d-a104-2174713dafdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:25:05 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:25:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb3fc5f-2f68-482e-b3cf-bd0b535830c6]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG os_brick.utils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:25:05 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating existing volume attachment record: 042488e7-2eeb-4ce1-a905-854a4251a4e5 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:25:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdumpcPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:25:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:25:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:25:16 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef02f0-8428-469f-b839-fad80da1e4bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:25:16 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ebba90-7995-469b-bacc-c99e3ae7372c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84] added
Dec 06 14:25:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e19c7c-ad3e-4618-8ddb-27663a5dc1d8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe8ecc-f770-4267-8247-08bedaee8f4f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdumpcPv {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdumpcPv" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d3deaf-e853-41a0-adfc-c84974572c2a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdumpcPv'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff5d79-17b7-4735-84f8-6695eb55fc8c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[93712be0-7dda-4bdb-9d7b-50f101a913de]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:16 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:16 user nova-compute[75326]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)
Dec 06 14:25:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:16 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:16 user nova-compute[75326]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)
Dec 06 14:25:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:25:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebdf6a4-d2dc-42c6-9d6c-bcd23b9718be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260]
Dec 06 14:25:17 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260] successful.
Dec 06 14:25:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f911020-e3c0-4431-9bc3-390d736ec566]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cadb4e-40c7-4a10-b585-cebae2daa144]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e85a610-249f-4948-a354-256a1a06e440 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:17 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de5999-c376-4955-ab56-50f6cd7591b6]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:25:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdumpcPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26563393933393963', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563393933393963', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:25:18 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:18 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:25:18 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:18 user nova-compute[75326]:   <serial>ae7f5ab2-a111-499e-aaba-ab89493c7d84</serial>
Dec 06 14:25:18 user nova-compute[75326]: </disk>
Dec 06 14:25:18 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No VIF found with MAC fa:16:3e:d4:6f:2c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:25:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b0980789-e528-4ce4-bff8-3e49cf2bd790 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.961s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:25:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:25:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:32 user nova-compute[75326]: INFO nova.compute.manager [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Detaching volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:25:32 user nova-compute[75326]: INFO nova.virt.block_device [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Attempting to driver detach volume 2056882b-3c26-427d-b8bf-ae4a6376e5b5 from mountpoint /dev/vdb
Dec 06 14:25:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Attempting to detach device vdb from instance 8f420a26-49d6-474d-8c32-750e9167564e from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:25:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:25:32 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:32 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:25:32 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:32 user nova-compute[75326]:   <serial>2056882b-3c26-427d-b8bf-ae4a6376e5b5</serial>
Dec 06 14:25:32 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:25:32 user nova-compute[75326]: </disk>
Dec 06 14:25:32 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:25:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully detached device vdb from instance 8f420a26-49d6-474d-8c32-750e9167564e from the persistent domain config.
Dec 06 14:25:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f420a26-49d6-474d-8c32-750e9167564e from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:25:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:25:32 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:32 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:25:32 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:32 user nova-compute[75326]:   <serial>2056882b-3c26-427d-b8bf-ae4a6376e5b5</serial>
Dec 06 14:25:32 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 14:25:32 user nova-compute[75326]: </disk>
Dec 06 14:25:32 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:25:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:25:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:35 user nova-compute[75326]: INFO nova.compute.manager [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Attaching volume 9e86725c-787d-4559-896e-4e84fc238cef to /dev/vdb
Dec 06 14:25:35 user nova-compute[75326]: DEBUG os_brick.utils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f43fa21-59fa-4cc4-ba4e-7b196f6a5245]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d511f-88c7-4559-be55-4c96904120b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.060s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb94da-8470-4016-881b-deb1184a1a92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e23c50-e813-4282-9b79-e04a1cf975c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:25:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:25:36 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:25:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4ca21-337a-474b-9bc2-df86925286b4]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG os_brick.utils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating existing volume attachment record: 63d50985-9c8a-4ac7-997d-dfa6c61275ef {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:25:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:25:41 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=25.207408905029297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 8f420a26-49d6-474d-8c32-750e9167564e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e7308382-95a1-4c2e-89e9-18462522bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:25:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:25:42 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:25:42 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:25:42 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:25:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [{"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a1572caf-4d57-4c7c-9250-636f19bfb73a" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQuPBXti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:25:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:25:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:25:47 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f707159f-7045-4fb3-af25-0900406f09f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:25:47 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d23e3-6510-4d53-8f6d-0f3012e54875]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef] added
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1ea462-000e-4db8-9bea-f0e12c44689b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90cc499-f8ff-44fe-838c-7df85c49fc73]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQuPBXti {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQuPBXti" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaceecad-0cc4-4038-af48-f2b8671ee666]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NQuPBXti'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c9ba62-825d-4972-9aeb-12f9a6b70e0e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a5b577-a178-4b7a-b48a-e4618f000c95]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608d0d9-e835-491b-b333-df356f81eede]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260]
Dec 06 14:25:47 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260] successful.
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c82daec-2e76-4021-b8d8-08058bf38e51]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80dde68-c9d3-431a-8c26-80baf441957b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:47 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:25:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c7a0c-2afd-422f-86b9-4b962d5d38a5]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:25:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQuPBXti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:25:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:25:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26231363535306533', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:25:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231363535306533', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:25:48 user nova-compute[75326]: DEBUG nova.objects.instance [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:25:48 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:48 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:25:48 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:48 user nova-compute[75326]:   <serial>9e86725c-787d-4559-896e-4e84fc238cef</serial>
Dec 06 14:25:48 user nova-compute[75326]: </disk>
Dec 06 14:25:48 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:25:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:25:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:25:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] No VIF found with MAC fa:16:3e:06:2e:94, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:25:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-234b4059-cdef-4395-a11a-8c161435cb38 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.624s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:25:51 user nova-compute[75326]: INFO nova.compute.claims [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Claim successful on node user
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:25:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing instance network info cache due to event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.network.neutron [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:25:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Creating image(s)
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "/opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "/opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:51 user nova-compute[75326]: DEBUG nova.policy [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feb48b6dbd4d4ca7872004f70d8bd92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7f51378e044785aa5ad4e64cd5549f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.224s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.231s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk 1073741824" returned: 0 in 0.062s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updated VIF entry in instance network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.network.neutron [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-84fd30e5-9d5d-4785-8d76-d594c137a499 req-3c43e7dd-306c-429e-b611-ac8d26e0d70b service nova] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.219s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Successfully created port: 3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Cannot resize image /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Ensure instance console log exists: /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f420a26-49d6-474d-8c32-750e9167564e is timed out.
Dec 06 14:25:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully detached device vdb from instance 8f420a26-49d6-474d-8c32-750e9167564e from the live domain config.
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgQnGawY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:25:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc158308-6828-45c2-9b7d-c7148711ea9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:25:53 user nova-compute[75326]: No targets found.
Dec 06 14:25:53 user nova-compute[75326]: iSNS:
Dec 06 14:25:53 user nova-compute[75326]: No targets found.
Dec 06 14:25:53 user nova-compute[75326]: STATIC:
Dec 06 14:25:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84
Dec 06 14:25:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:25:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:25:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:25:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:25:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:25:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:25:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:25:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:25:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5
Dec 06 14:25:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:25:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:25:53 user nova-compute[75326]: FIRMWARE:
Dec 06 14:25:53 user nova-compute[75326]: No targets found.
Dec 06 14:25:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:25:53 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:25:53 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Successfully updated port: 3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bc7f1f-4b3a-466f-a9a1-6e014a254bdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquired lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb88786-6b74-4df7-b9c6-7b2fd386f4b1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:25:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:25:53 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:25:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-changed-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Refreshing instance network info cache due to event network-changed-3728c80c-50e6-434b-8c93-75bac00f8310. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] Acquiring lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2867047-ee6b-4ac2-8e71-33e31f94f50e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb15592-c384-4bce-ae1e-199a01386a97]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59bab60-0bc5-4dd4-8f20-2c94801da098]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df1159-5329-406e-ac37-641bc0f61d6c]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6604d2c3-3470-4828-9355-fbf231e80a29]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:53 user nova-compute[75326]: INFO nova.compute.manager [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Detaching volume ae7f5ab2-a111-499e-aaba-ab89493c7d84
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee478e3d-0748-4481-946c-1885adeb6d1f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260]
Dec 06 14:25:53 user nova-compute[75326]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5, portal: 172.16.0.220,3260] successful.
Dec 06 14:25:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056882b-3c26-427d-b8bf-ae4a6376e5b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ecd1f9-7c3c-48fc-9871-b14d8cbddeb3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== disconnect_volume: return (387ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:25:53 user nova-compute[75326]: INFO nova.virt.block_device [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Attempting to driver detach volume ae7f5ab2-a111-499e-aaba-ab89493c7d84 from mountpoint /dev/vdb
Dec 06 14:25:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Attempting to detach device vdb from instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:25:53 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:53 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:25:53 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:53 user nova-compute[75326]:   <serial>ae7f5ab2-a111-499e-aaba-ab89493c7d84</serial>
Dec 06 14:25:53 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:25:53 user nova-compute[75326]: </disk>
Dec 06 14:25:53 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:25:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully detached device vdb from instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b from the persistent domain config.
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:25:53 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:25:53 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:25:53 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:25:53 user nova-compute[75326]:   <serial>ae7f5ab2-a111-499e-aaba-ab89493c7d84</serial>
Dec 06 14:25:53 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:25:53 user nova-compute[75326]: </disk>
Dec 06 14:25:53 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Updating instance_info_cache with network_info: [{"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Releasing lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Instance network_info: |[{"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] Acquired lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Refreshing network info cache for port 3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Start _get_guest_xml network_info=[{"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:25:54 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:25:54 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822867811',display_name='tempest-VolumesNegativeTest-instance-1822867811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822867811',id=36,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7f51378e044785aa5ad4e64cd5549f',ramdisk_id='',reservation_id='r-ppk0b04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1694769541',owner_user_name='tempest-VolumesNegativeTest-1694769541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:25:52Z,user_data=None,user_id='feb48b6dbd4d4ca7872004f70d8bd92e',uuid=ec544a60-1882-4092-ab63-7cdd85fe3108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converting VIF {"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lazy-loading 'pci_devices' on Instance uuid ec544a60-1882-4092-ab63-7cdd85fe3108 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:25:54 user nova-compute[75326]:   <uuid>ec544a60-1882-4092-ab63-7cdd85fe3108</uuid>
Dec 06 14:25:54 user nova-compute[75326]:   <name>instance-00000024</name>
Dec 06 14:25:54 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:25:54 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:25:54 user nova-compute[75326]:   <metadata>
Dec 06 14:25:54 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:25:54 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:name>tempest-VolumesNegativeTest-instance-1822867811</nova:name>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:25:54</nova:creationTime>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:25:54 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:25:54 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:owner>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:user uuid="feb48b6dbd4d4ca7872004f70d8bd92e">tempest-VolumesNegativeTest-1694769541-project-member</nova:user>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:project uuid="bb7f51378e044785aa5ad4e64cd5549f">tempest-VolumesNegativeTest-1694769541</nova:project>
Dec 06 14:25:54 user nova-compute[75326]:       </nova:owner>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:25:54 user nova-compute[75326]:       <nova:ports>
Dec 06 14:25:54 user nova-compute[75326]:         <nova:port uuid="3728c80c-50e6-434b-8c93-75bac00f8310">
Dec 06 14:25:54 user nova-compute[75326]:           <nova:ip type="fixed" address="192.168.233.159" ipVersion="4"/>
Dec 06 14:25:54 user nova-compute[75326]:         </nova:port>
Dec 06 14:25:54 user nova-compute[75326]:       </nova:ports>
Dec 06 14:25:54 user nova-compute[75326]:     </nova:instance>
Dec 06 14:25:54 user nova-compute[75326]:   </metadata>
Dec 06 14:25:54 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:25:54 user nova-compute[75326]:     <system>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="serial">ec544a60-1882-4092-ab63-7cdd85fe3108</entry>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="uuid">ec544a60-1882-4092-ab63-7cdd85fe3108</entry>
Dec 06 14:25:54 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:25:54 user nova-compute[75326]:     </system>
Dec 06 14:25:54 user nova-compute[75326]:   </sysinfo>
Dec 06 14:25:54 user nova-compute[75326]:   <os>
Dec 06 14:25:54 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:25:54 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:25:54 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:25:54 user nova-compute[75326]:   </os>
Dec 06 14:25:54 user nova-compute[75326]:   <features>
Dec 06 14:25:54 user nova-compute[75326]:     <acpi/>
Dec 06 14:25:54 user nova-compute[75326]:     <apic/>
Dec 06 14:25:54 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:25:54 user nova-compute[75326]:   </features>
Dec 06 14:25:54 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:25:54 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:25:54 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:25:54 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:25:54 user nova-compute[75326]:   </clock>
Dec 06 14:25:54 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:25:54 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:25:54 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:25:54 user nova-compute[75326]:   </cpu>
Dec 06 14:25:54 user nova-compute[75326]:   <devices>
Dec 06 14:25:54 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:25:54 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:25:54 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk"/>
Dec 06 14:25:54 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:25:54 user nova-compute[75326]:     </disk>
Dec 06 14:25:54 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:25:54 user nova-compute[75326]:       <mac address="fa:16:3e:38:82:da"/>
Dec 06 14:25:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:25:54 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:25:54 user nova-compute[75326]:       <target dev="tap3728c80c-50"/>
Dec 06 14:25:54 user nova-compute[75326]:     </interface>
Dec 06 14:25:54 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:25:54 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/console.log" append="off"/>
Dec 06 14:25:54 user nova-compute[75326]:     </serial>
Dec 06 14:25:54 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:25:54 user nova-compute[75326]:     <video>
Dec 06 14:25:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:25:54 user nova-compute[75326]:     </video>
Dec 06 14:25:54 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:25:54 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:25:54 user nova-compute[75326]:     </rng>
Dec 06 14:25:54 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:25:54 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:25:54 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:25:54 user nova-compute[75326]:     </memballoon>
Dec 06 14:25:54 user nova-compute[75326]:   </devices>
Dec 06 14:25:54 user nova-compute[75326]: </domain>
Dec 06 14:25:54 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822867811',display_name='tempest-VolumesNegativeTest-instance-1822867811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822867811',id=36,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7f51378e044785aa5ad4e64cd5549f',ramdisk_id='',reservation_id='r-ppk0b04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1694769541',owner_user_name='tempest-VolumesNegativeTest-1694769541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:25:52Z,user_data=None,user_id='feb48b6dbd4d4ca7872004f70d8bd92e',uuid=ec544a60-1882-4092-ab63-7cdd85fe3108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converting VIF {"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG os_vif [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a67f2058-4aef-5882-bf22-827b28586b8d', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3728c80c-50, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3728c80c-50, col_values=(('qos', UUID('7b4ea4b4-2c51-466b-a228-8b88240be687')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3728c80c-50, col_values=(('external_ids', {'iface-id': '3728c80c-50e6-434b-8c93-75bac00f8310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:82:da', 'vm-uuid': 'ec544a60-1882-4092-ab63-7cdd85fe3108'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:54 user nova-compute[75326]: INFO os_vif [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50')
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] No VIF found with MAC fa:16:3e:38:82:da, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Updated VIF entry in instance network info cache for port 3728c80c-50e6-434b-8c93-75bac00f8310. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Updating instance_info_cache with network_info: [{"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-29f5986c-e2b8-43ce-95d2-c2f186fe8566 req-ada550dc-cd8b-40df-aa03-cabbdf3a65cc service nova] Releasing lock "refresh_cache-ec544a60-1882-4092-ab63-7cdd85fe3108" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing instance network info cache due to event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'flavor' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:25:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9cb4ed61-07f8-4f03-8818-c16acc59a70c tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.171s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:55 user nova-compute[75326]: INFO nova.compute.manager [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Rebooting instance
Dec 06 14:25:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG nova.network.neutron [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updated VIF entry in instance network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG nova.network.neutron [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-13ef1515-ac92-4fcc-a4ab-f5e599c28c36 req-44df92fe-34d9-47e2-aae5-4fab72fb3ea6 service nova] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG nova.network.neutron [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:25:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG nova.network.neutron [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:25:56 user nova-compute[75326]: WARNING nova.compute.manager [req-86461a13-a43b-4717-9d5f-54c293cd80e7 req-18516ba6-57a5-47df-ab4c-df014973e6c2 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state building and task_state spawning.
Dec 06 14:25:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:25:58 user nova-compute[75326]: WARNING nova.compute.manager [req-313e34c7-bdd5-4669-930e-15ea5f2194e8 req-9a5eba78-3db5-412e-b954-e31e350cf2a6 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state building and task_state spawning.
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:25:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Instance spawned successfully.
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:58 user nova-compute[75326]: INFO nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Took 6.84 seconds to spawn the instance on the hypervisor.
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:25:58 user nova-compute[75326]: WARNING nova.compute.manager [req-4388fcab-7fff-4c2c-bfc2-1efdc965ea0b req-0ee808ae-1ab8-4aaf-940e-77f0adbfdade service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state active and task_state reboot_started.
Dec 06 14:25:58 user nova-compute[75326]: INFO nova.compute.manager [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Took 7.65 seconds to build instance.
Dec 06 14:25:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6b8155d6-93b8-48a4-bdd1-121047a82207 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.767s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:25:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:25:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance shutdown successfully.
Dec 06 14:26:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:00 user nova-compute[75326]: WARNING nova.compute.manager [req-5fb0f6e2-660e-4cc2-84b2-a49b3028869a req-cda8e9d5-30c9-4a59-bf0b-c3b5d9077ee4 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state active and task_state reboot_started.
Dec 06 14:26:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:02 user nova-compute[75326]: WARNING nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state active and task_state reboot_started.
Dec 06 14:26:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:02 user nova-compute[75326]: WARNING nova.compute.manager [req-7b9ad53c-1c77-48fd-a12d-121636b28e48 req-b46e7593-d56e-4e0c-866b-7d626482172a service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state active and task_state reboot_started.
Dec 06 14:26:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance running successfully.
Dec 06 14:26:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance soft rebooted successfully.
Dec 06 14:26:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:26:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-545e6826-f0bc-45db-b007-63629fd3e73e tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.103s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:11 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing instance network info cache due to event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:26:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:26:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:26:11 user nova-compute[75326]: DEBUG nova.network.neutron [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:12 user nova-compute[75326]: INFO nova.compute.manager [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Detaching volume b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:26:12 user nova-compute[75326]: INFO nova.virt.block_device [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Attempting to driver detach volume b2f0543f-9bef-4190-afa4-4eb03ac51e2a from mountpoint /dev/vdb
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Attempting to detach device vdb from instance 90182363-4e9a-47be-93da-9dc41de98d4d from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:26:12 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:26:12 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:26:12 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:26:12 user nova-compute[75326]:   <serial>b2f0543f-9bef-4190-afa4-4eb03ac51e2a</serial>
Dec 06 14:26:12 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:26:12 user nova-compute[75326]: </disk>
Dec 06 14:26:12 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:26:12 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully detached device vdb from instance 90182363-4e9a-47be-93da-9dc41de98d4d from the persistent domain config.
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90182363-4e9a-47be-93da-9dc41de98d4d from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:26:12 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:26:12 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 14:26:12 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:26:12 user nova-compute[75326]:   <serial>b2f0543f-9bef-4190-afa4-4eb03ac51e2a</serial>
Dec 06 14:26:12 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:26:12 user nova-compute[75326]: </disk>
Dec 06 14:26:12 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updated VIF entry in instance network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8fca939-1974-461e-97ff-16b09df5fe58 req-f014fc92-abbf-47e7-8808-d813bb6301ac service nova] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:26:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing instance network info cache due to event network-changed-bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] Acquiring lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] Acquired lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG nova.network.neutron [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Refreshing network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:26:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updated VIF entry in instance network info cache for port bfaffc42-371b-4ebb-8216-65f90d996612. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [{"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7a155d81-3127-4c7a-86d0-e68f8564a639 req-981dcbb9-38b8-46d1-8946-15afa9e3d868 service nova] Releasing lock "refresh_cache-90182363-4e9a-47be-93da-9dc41de98d4d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:26:14 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b is timed out.
Dec 06 14:26:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully detached device vdb from instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b from the live domain config.
Dec 06 14:26:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdumpcPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:26:14 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20dfe91-0294-40e9-a4c4-4582bd9f89aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:26:14 user nova-compute[75326]: No targets found.
Dec 06 14:26:14 user nova-compute[75326]: iSNS:
Dec 06 14:26:14 user nova-compute[75326]: No targets found.
Dec 06 14:26:14 user nova-compute[75326]: STATIC:
Dec 06 14:26:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84
Dec 06 14:26:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:26:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10
Dec 06 14:26:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:14 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:26:14 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:14 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:14 user nova-compute[75326]: FIRMWARE:
Dec 06 14:26:14 user nova-compute[75326]: No targets found.
Dec 06 14:26:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:26:14 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:26:14 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab5538-b44a-420e-9271-b847e9e71b22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c019cc-08a0-4cdf-b334-e22d7b6f6065]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:14 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4382560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1d9627-23d0-45e9-8217-6dfe30acd1e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab77854-d183-4da7-9c8b-895a3272e830]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d9bc1-6d83-4552-b6fd-007adaca2005]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a1a3a-a610-443e-8413-5ed84e54570e]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531f766-9419-4f9f-9656-338c7597f735]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b8b58-9492-4594-a1e7-5b5a5a767ec9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260]
Dec 06 14:26:14 user nova-compute[75326]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84, portal: 172.16.0.220,3260] successful.
Dec 06 14:26:14 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48712dd0-638c-4c3f-a5a9-41a0cf092a8c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:26:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:26:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5eef88e6-5725-44ab-85f0-ae3a46e64813 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.178s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 26.056s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:19 user nova-compute[75326]: INFO nova.compute.manager [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Terminating instance
Dec 06 14:26:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-unplugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] No waiting events found dispatching network-vif-unplugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-8465b646-9397-48b9-a8c3-e7333e58c853 req-5370f7fc-e887-4cd5-9ba9-279530850ddf service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-unplugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:26:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Instance destroyed successfully.
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'resources' on Instance uuid 572d7e24-62ec-4fd8-8edf-d77615e4cf1b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2134674300',display_name='tempest-VolumesSnapshotTestJSON-instance-2134674300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2134674300',id=34,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5K6NsbaBo10afYuBvRo4ZPSAWTdnyt5h9H2qP4cz7lrPmD1sF788DamoAAptcYAxfjyDa9EkPpIRBbtwMulO+19ABGOKFTXYlLpVj2Hm8IZgYo6O7yO0u78vptvBF3lw==',key_name='tempest-keypair-363721430',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:23:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-zg7rl17d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=572d7e24-62ec-4fd8-8edf-d77615e4cf1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "address": "fa:16:3e:d4:6f:2c", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96ca970-4e", "ovs_interfaceid": "f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_vif [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf96ca970-4e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=969b45ae-a6f4-473f-a01e-54061faa861f) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:20 user nova-compute[75326]: INFO os_vif [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:6f:2c,bridge_name='br-int',has_traffic_filtering=True,id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96ca970-4e')
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdumpcPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:26:20 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[594ec03e-9fc6-49fa-b37b-f534d211f226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:26:20 user nova-compute[75326]: No targets found.
Dec 06 14:26:20 user nova-compute[75326]: iSNS:
Dec 06 14:26:20 user nova-compute[75326]: No targets found.
Dec 06 14:26:20 user nova-compute[75326]: STATIC:
Dec 06 14:26:20 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:26:20 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:20 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:20 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10
Dec 06 14:26:20 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:20 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:20 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed
Dec 06 14:26:20 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:20 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:20 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:26:20 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:20 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:20 user nova-compute[75326]: FIRMWARE:
Dec 06 14:26:20 user nova-compute[75326]: No targets found.
Dec 06 14:26:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:26:20 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:26:20 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7f5ab2-a111-499e-aaba-ab89493c7d84', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62206a-0b47-4a82-93d7-fa86aff9ad14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7261c994-b59c-46dc-8b6a-b4e9b2329842]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)
Dec 06 14:26:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:20 user nova-compute[75326]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)
Dec 06 14:26:20 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44df010>, {}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Disconnecting from: [] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== disconnect_volume: return (88ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:26:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:26:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Deleting instance files /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b_del
Dec 06 14:26:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Deletion of /opt/stack/data/nova/instances/572d7e24-62ec-4fd8-8edf-d77615e4cf1b_del complete
Dec 06 14:26:21 user nova-compute[75326]: INFO nova.compute.manager [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 06 14:26:21 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:26:21 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:26:21 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:22 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Took 1.16 seconds to deallocate network for instance.
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-bca5870b-8471-46f0-8cf5-3360c76475ee req-ff76d3a5-474d-4354-acff-e9b365a0cf5f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-deleted-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:22 user nova-compute[75326]: INFO nova.compute.manager [req-bca5870b-8471-46f0-8cf5-3360c76475ee req-ff76d3a5-474d-4354-acff-e9b365a0cf5f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Neutron deleted interface f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba; detaching it from the instance and deleting it from the info cache
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.network.neutron [req-bca5870b-8471-46f0-8cf5-3360c76475ee req-ff76d3a5-474d-4354-acff-e9b365a0cf5f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-bca5870b-8471-46f0-8cf5-3360c76475ee req-ff76d3a5-474d-4354-acff-e9b365a0cf5f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Detach interface failed, port_id=f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba, reason: Instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:26:22 user nova-compute[75326]: WARNING nova.volume.cinder [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Attachment 042488e7-2eeb-4ce1-a905-854a4251a4e5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 042488e7-2eeb-4ce1-a905-854a4251a4e5. (HTTP 404) (Request-ID: req-eff5a1db-e032-4f3e-8383-bbac85112c96)
Dec 06 14:26:22 user nova-compute[75326]: INFO nova.compute.manager [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Took 0.11 seconds to detach 1 volumes for instance.
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] Acquiring lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] No waiting events found dispatching network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:22 user nova-compute[75326]: WARNING nova.compute.manager [req-ff980f41-a2ff-421d-888c-42e5a986f965 req-2c11e7f9-ca8c-4ae6-8228-517e55fde51f service nova] [instance: 572d7e24-62ec-4fd8-8edf-d77615e4cf1b] Received unexpected event network-vif-plugged-f96ca970-4e2a-4c9b-b3a0-9accd4ccf0ba for instance with vm_state active and task_state deleting.
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:26:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:22 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Deleted allocations for instance 572d7e24-62ec-4fd8-8edf-d77615e4cf1b
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-8420697d-64f1-4d16-bc0b-22a7cf7b0498 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "572d7e24-62ec-4fd8-8edf-d77615e4cf1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.064s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:23 user nova-compute[75326]: INFO nova.compute.manager [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Terminating instance
Dec 06 14:26:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-afbdc554-f344-4fd3-815d-a64ced95e6c5 req-03b70224-7983-4fc7-955e-af5b0d6ce306 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-unplugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Instance destroyed successfully.
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'resources' on Instance uuid 8f420a26-49d6-474d-8c32-750e9167564e {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1255368613',display_name='tempest-ServerActionsTestOtherA-server-72701268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1255368613',id=32,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyH7MNtqmG1KFHHK6QydmBv5VzSyV6twW1nbb06PloJnoEGSbTA9ZiJLvf8LquSbrWMBN/tase6Jbv4ssfUW8Q6CG5ruCg7s4u/R3kThBspzpuqXzjhJBhZTCG0lFan2A==',key_name='tempest-keypair-1726306684',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-g3a3d51z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=8f420a26-49d6-474d-8c32-750e9167564e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "c2a526e1-0870-43c1-8577-3359acb2102a", "address": "fa:16:3e:06:bb:07", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a526e1-08", "ovs_interfaceid": "c2a526e1-0870-43c1-8577-3359acb2102a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG os_vif [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a526e1-08, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0b7c002-5243-4b44-9cff-f6ed9a454aed) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:24 user nova-compute[75326]: INFO os_vif [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:bb:07,bridge_name='br-int',has_traffic_filtering=True,id=c2a526e1-0870-43c1-8577-3359acb2102a,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a526e1-08')
Dec 06 14:26:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Deleting instance files /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e_del
Dec 06 14:26:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Deletion of /opt/stack/data/nova/instances/8f420a26-49d6-474d-8c32-750e9167564e_del complete
Dec 06 14:26:24 user nova-compute[75326]: INFO nova.compute.manager [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 06 14:26:24 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:26:24 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:25 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Took 0.95 seconds to deallocate network for instance.
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-4893eaca-4c3b-49d9-90e3-86b0c1e561db req-6e2eea11-2ae0-45c0-b95b-a8301b1b2610 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-deleted-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:25 user nova-compute[75326]: INFO nova.compute.manager [req-4893eaca-4c3b-49d9-90e3-86b0c1e561db req-6e2eea11-2ae0-45c0-b95b-a8301b1b2610 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Neutron deleted interface c2a526e1-0870-43c1-8577-3359acb2102a; detaching it from the instance and deleting it from the info cache
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-4893eaca-4c3b-49d9-90e3-86b0c1e561db req-6e2eea11-2ae0-45c0-b95b-a8301b1b2610 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-4893eaca-4c3b-49d9-90e3-86b0c1e561db req-6e2eea11-2ae0-45c0-b95b-a8301b1b2610 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Detach interface failed, port_id=c2a526e1-0870-43c1-8577-3359acb2102a, reason: Instance 8f420a26-49d6-474d-8c32-750e9167564e could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] Acquiring lock "8f420a26-49d6-474d-8c32-750e9167564e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] Lock "8f420a26-49d6-474d-8c32-750e9167564e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] No waiting events found dispatching network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:26:25 user nova-compute[75326]: WARNING nova.compute.manager [req-99adbc95-cd48-4818-bfcf-6120581b6956 req-4063f1a9-17b2-4a44-bd41-21731ef5a607 service nova] [instance: 8f420a26-49d6-474d-8c32-750e9167564e] Received unexpected event network-vif-plugged-c2a526e1-0870-43c1-8577-3359acb2102a for instance with vm_state deleted and task_state None.
Dec 06 14:26:25 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Deleted allocations for instance 8f420a26-49d6-474d-8c32-750e9167564e
Dec 06 14:26:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-05b420f8-495b-44fa-bfab-f2981ed0878e tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "8f420a26-49d6-474d-8c32-750e9167564e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:32 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90182363-4e9a-47be-93da-9dc41de98d4d is timed out.
Dec 06 14:26:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully detached device vdb from instance 90182363-4e9a-47be-93da-9dc41de98d4d from the live domain config.
Dec 06 14:26:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJCXeTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:26:32 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb7254-84bd-4c6a-a52d-09dbc4255768]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:26:32 user nova-compute[75326]: No targets found.
Dec 06 14:26:32 user nova-compute[75326]: iSNS:
Dec 06 14:26:32 user nova-compute[75326]: No targets found.
Dec 06 14:26:32 user nova-compute[75326]: STATIC:
Dec 06 14:26:32 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a
Dec 06 14:26:32 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:32 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:32 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10
Dec 06 14:26:32 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:32 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:32 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed
Dec 06 14:26:32 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:32 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:32 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:26:32 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:26:32 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:26:32 user nova-compute[75326]: FIRMWARE:
Dec 06 14:26:32 user nova-compute[75326]: No targets found.
Dec 06 14:26:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:26:32 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:26:32 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[27685ba9-e6a0-413e-b39b-af84f4136a9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952da1b-a1b8-4803-abc9-b77c4e907dfa]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)
Dec 06 14:26:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23da12f0-7617-435f-9d59-25e89b03ca10 (non-flash)
Dec 06 14:26:32 user nova-compute[75326]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1cf0f3-389a-4a8a-a5e6-4521d3204fed (non-flash)
Dec 06 14:26:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d976e1a-afc3-4a37-9f96-141abc0b0013]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5726da4-7eea-41f4-9b3d-196ad9d55e14]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7fac7-6a6b-4f76-ba7a-a3ae17a49a47]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b805bff-4cc2-4e79-8957-1f2509413937]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b387c-789f-45e1-b7a7-df80243f750e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b2a2a-2676-4769-83f8-02ee0d18c610]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260]
Dec 06 14:26:33 user nova-compute[75326]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a, portal: 172.16.0.220,3260] successful.
Dec 06 14:26:33 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0543f-9bef-4190-afa4-4eb03ac51e2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4020729-27fd-43af-b696-6eff70ccbad4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:26:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:34 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'flavor' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:26:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b4cc0aab-5413-4c06-899b-c19878f52304 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:36 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:26:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:26:40 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.204025268554688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 90182363-4e9a-47be-93da-9dc41de98d4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e7308382-95a1-4c2e-89e9-18462522bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ec544a60-1882-4092-ab63-7cdd85fe3108 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:26:40 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:26:41 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:26:41 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:26:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:26:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:26:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [{"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-82db1a45-6725-46c9-9359-cf1b0cb90e65" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:26:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:26:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:02 user nova-compute[75326]: INFO nova.compute.manager [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Terminating instance
Dec 06 14:27:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-082b8dc1-0075-43f7-a6f0-312e9eabc3e6 req-4693bad5-bed8-42d1-afa4-5722ee1b09c9 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-unplugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Instance destroyed successfully.
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid 90182363-4e9a-47be-93da-9dc41de98d4d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-179122323',display_name='tempest-ServerRescueNegativeTestJSON-server-179122323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-179122323',id=30,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDo4KtQFM7EcVVHt7y/hycZVjZUXQlwTsbBRR7uN2iZEHpsd8nONHCpP6FlDhIZnE9umGWZdGhAgSmo2hmSWtXZ3C+aD4PJwQzZZfdqqGLLYWElfJjHkya3UCo2nUVktLg==',key_name='tempest-keypair-1954013525',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-hwfmt608',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='779267c6564b43c293a1025a9c575b13',uuid=90182363-4e9a-47be-93da-9dc41de98d4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "bfaffc42-371b-4ebb-8216-65f90d996612", "address": "fa:16:3e:bc:0c:f6", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfaffc42-37", "ovs_interfaceid": "bfaffc42-371b-4ebb-8216-65f90d996612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG os_vif [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfaffc42-37, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2b9b935-136d-4fc2-af75-1eb679e390b6) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:03 user nova-compute[75326]: INFO os_vif [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=bfaffc42-371b-4ebb-8216-65f90d996612,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfaffc42-37')
Dec 06 14:27:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Deleting instance files /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d_del
Dec 06 14:27:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Deletion of /opt/stack/data/nova/instances/90182363-4e9a-47be-93da-9dc41de98d4d_del complete
Dec 06 14:27:03 user nova-compute[75326]: INFO nova.compute.manager [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 06 14:27:03 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:27:03 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:27:04 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:04 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Took 0.77 seconds to deallocate network for instance.
Dec 06 14:27:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:27:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:27:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:04 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Deleted allocations for instance 90182363-4e9a-47be-93da-9dc41de98d4d
Dec 06 14:27:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c0d68cb4-86c5-409c-b879-07153deac4e4 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "90182363-4e9a-47be-93da-9dc41de98d4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] Acquiring lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] Lock "90182363-4e9a-47be-93da-9dc41de98d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] No waiting events found dispatching network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:05 user nova-compute[75326]: WARNING nova.compute.manager [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received unexpected event network-vif-plugged-bfaffc42-371b-4ebb-8216-65f90d996612 for instance with vm_state deleted and task_state None.
Dec 06 14:27:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-c75038dc-63ee-444d-add5-07f3a81592ae req-bc1dbec1-c923-4078-a99d-46fa29866278 service nova] [instance: 90182363-4e9a-47be-93da-9dc41de98d4d] Received event network-vif-deleted-bfaffc42-371b-4ebb-8216-65f90d996612 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:27:10 user nova-compute[75326]: INFO nova.compute.claims [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Claim successful on node user
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:27:10 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.policy [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f383064f7aad4c1e920149c5ec072c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618552d8f75d49e39a2ebdf7c8724e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:27:10 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Creating image(s)
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "/opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "/opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "/opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.205s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.201s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk 1073741824" returned: 0 in 0.052s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Cannot resize image /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Ensure instance console log exists: /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:11 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Successfully created port: 0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Successfully updated port: 0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquired lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-changed-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.compute.manager [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Refreshing instance network info cache due to event network-changed-0ef135bd-9db1-4c64-968f-810cebf05dc6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] Acquiring lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updating instance_info_cache with network_info: [{"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Releasing lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Instance network_info: |[{"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] Acquired lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Refreshing network info cache for port 0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Start _get_guest_xml network_info=[{"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:27:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1294179195',display_name='tempest-VolumesSnapshotTestJSON-instance-1294179195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1294179195',id=37,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl4xXawBH++rL0NrfxUf4TYxHyfGfaU95sWXdAekC+XhlRCUfpdvH546fLypxyLer9Ja/8EAMvOyS7qEoqdjhhAdg5YmctLO2gfyxlgbmKfkykJwN+vIJyQKccpbFBkEw==',key_name='tempest-keypair-250263465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-vmz0ki3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=49dcd579-59ad-4cf9-a2bf-6114e66a5921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'pci_devices' on Instance uuid 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:27:12 user nova-compute[75326]:   <uuid>49dcd579-59ad-4cf9-a2bf-6114e66a5921</uuid>
Dec 06 14:27:12 user nova-compute[75326]:   <name>instance-00000025</name>
Dec 06 14:27:12 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:27:12 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:27:12 user nova-compute[75326]:   <metadata>
Dec 06 14:27:12 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:27:12 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1294179195</nova:name>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:27:12</nova:creationTime>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:27:12 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:27:12 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:owner>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:user uuid="f383064f7aad4c1e920149c5ec072c0f">tempest-VolumesSnapshotTestJSON-59172741-project-member</nova:user>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:project uuid="618552d8f75d49e39a2ebdf7c8724e88">tempest-VolumesSnapshotTestJSON-59172741</nova:project>
Dec 06 14:27:12 user nova-compute[75326]:       </nova:owner>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:27:12 user nova-compute[75326]:       <nova:ports>
Dec 06 14:27:12 user nova-compute[75326]:         <nova:port uuid="0ef135bd-9db1-4c64-968f-810cebf05dc6">
Dec 06 14:27:12 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 14:27:12 user nova-compute[75326]:         </nova:port>
Dec 06 14:27:12 user nova-compute[75326]:       </nova:ports>
Dec 06 14:27:12 user nova-compute[75326]:     </nova:instance>
Dec 06 14:27:12 user nova-compute[75326]:   </metadata>
Dec 06 14:27:12 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:27:12 user nova-compute[75326]:     <system>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="serial">49dcd579-59ad-4cf9-a2bf-6114e66a5921</entry>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="uuid">49dcd579-59ad-4cf9-a2bf-6114e66a5921</entry>
Dec 06 14:27:12 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:27:12 user nova-compute[75326]:     </system>
Dec 06 14:27:12 user nova-compute[75326]:   </sysinfo>
Dec 06 14:27:12 user nova-compute[75326]:   <os>
Dec 06 14:27:12 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:27:12 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:27:12 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:27:12 user nova-compute[75326]:   </os>
Dec 06 14:27:12 user nova-compute[75326]:   <features>
Dec 06 14:27:12 user nova-compute[75326]:     <acpi/>
Dec 06 14:27:12 user nova-compute[75326]:     <apic/>
Dec 06 14:27:12 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:27:12 user nova-compute[75326]:   </features>
Dec 06 14:27:12 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:27:12 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:27:12 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:27:12 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:27:12 user nova-compute[75326]:   </clock>
Dec 06 14:27:12 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:27:12 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:27:12 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:27:12 user nova-compute[75326]:   </cpu>
Dec 06 14:27:12 user nova-compute[75326]:   <devices>
Dec 06 14:27:12 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:27:12 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:27:12 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk"/>
Dec 06 14:27:12 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:27:12 user nova-compute[75326]:     </disk>
Dec 06 14:27:12 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:27:12 user nova-compute[75326]:       <mac address="fa:16:3e:0a:9c:b6"/>
Dec 06 14:27:12 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:27:12 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:27:12 user nova-compute[75326]:       <target dev="tap0ef135bd-9d"/>
Dec 06 14:27:12 user nova-compute[75326]:     </interface>
Dec 06 14:27:12 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:27:12 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/console.log" append="off"/>
Dec 06 14:27:12 user nova-compute[75326]:     </serial>
Dec 06 14:27:12 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:27:12 user nova-compute[75326]:     <video>
Dec 06 14:27:12 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:27:12 user nova-compute[75326]:     </video>
Dec 06 14:27:12 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:27:12 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:27:12 user nova-compute[75326]:     </rng>
Dec 06 14:27:12 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:27:12 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:27:12 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:27:12 user nova-compute[75326]:     </memballoon>
Dec 06 14:27:12 user nova-compute[75326]:   </devices>
Dec 06 14:27:12 user nova-compute[75326]: </domain>
Dec 06 14:27:12 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1294179195',display_name='tempest-VolumesSnapshotTestJSON-instance-1294179195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1294179195',id=37,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl4xXawBH++rL0NrfxUf4TYxHyfGfaU95sWXdAekC+XhlRCUfpdvH546fLypxyLer9Ja/8EAMvOyS7qEoqdjhhAdg5YmctLO2gfyxlgbmKfkykJwN+vIJyQKccpbFBkEw==',key_name='tempest-keypair-250263465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-vmz0ki3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=49dcd579-59ad-4cf9-a2bf-6114e66a5921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG os_vif [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '250568be-c3f5-5d49-a557-fd7c1e0dd060', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef135bd-9d, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ef135bd-9d, col_values=(('qos', UUID('19d50e22-3d2f-4809-85a3-5d6da9daf1b5')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ef135bd-9d, col_values=(('external_ids', {'iface-id': '0ef135bd-9db1-4c64-968f-810cebf05dc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:9c:b6', 'vm-uuid': '49dcd579-59ad-4cf9-a2bf-6114e66a5921'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:12 user nova-compute[75326]: INFO os_vif [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d')
Dec 06 14:27:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:27:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No VIF found with MAC fa:16:3e:0a:9c:b6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:27:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:13 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updated VIF entry in instance network info cache for port 0ef135bd-9db1-4c64-968f-810cebf05dc6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:27:13 user nova-compute[75326]: DEBUG nova.network.neutron [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updating instance_info_cache with network_info: [{"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a5000d30-8568-4a69-8a6b-1adcacb15489 req-1d93a267-e3cc-403e-8e3d-2fc437cb3908 service nova] Releasing lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] No waiting events found dispatching network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:14 user nova-compute[75326]: WARNING nova.compute.manager [req-8d699935-9031-4957-8fd6-cebbebf1097f req-3a428449-320d-4584-83c1-8c8a23d2e0a2 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received unexpected event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 for instance with vm_state building and task_state spawning.
Dec 06 14:27:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:27:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Instance spawned successfully.
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] No waiting events found dispatching network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:16 user nova-compute[75326]: WARNING nova.compute.manager [req-7eed1f14-edf1-43d7-a21b-3a9a8e7ba07b req-38a3ee80-4688-4642-863c-65735f158c6b service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received unexpected event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 for instance with vm_state building and task_state spawning.
Dec 06 14:27:16 user nova-compute[75326]: INFO nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Took 6.05 seconds to spawn the instance on the hypervisor.
Dec 06 14:27:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:27:16 user nova-compute[75326]: INFO nova.compute.manager [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Took 6.93 seconds to build instance.
Dec 06 14:27:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61069898-6704-4cda-a5e8-7262b1e73cda tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.057s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:27:18 user nova-compute[75326]: INFO nova.compute.claims [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Claim successful on node user
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:27:18 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:27:18 user nova-compute[75326]: DEBUG nova.policy [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '883471c60ead40db9e148780c24291e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef397319fcd4eb1a31fec14fa55847a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:27:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Creating image(s)
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "/opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "/opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "/opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.197s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk 1073741824" returned: 0 in 0.055s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Successfully created port: 1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.232s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Cannot resize image /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Ensure instance console log exists: /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Successfully updated port: 1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquired lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-changed-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Refreshing instance network info cache due to event network-changed-1dbd6361-75b8-42c4-af85-c4758b0a553d. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] Acquiring lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updating instance_info_cache with network_info: [{"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Releasing lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Instance network_info: |[{"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] Acquired lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.neutron [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Refreshing network info cache for port 1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Start _get_guest_xml network_info=[{"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:27:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:20 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2146114',id=38,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXc2aoX7u1j4U9AZ5KVSxS2mkOtG0qJxIRoa9GErV4m3AHfOqh+olzd/ALoZ2uJ98Va5EYzKqDbjUyEdZDt0mdjR8WkTvFIh/Al0CMEyyyFbndAYh2VXGXgZYtP28aO8Q==',key_name='tempest-keypair-1666065403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef397319fcd4eb1a31fec14fa55847a',ramdisk_id='',reservation_id='r-pc6zot0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:27:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='883471c60ead40db9e148780c24291e8',uuid=5378aa00-65c1-43c2-bbd5-0daf4e0e061f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converting VIF {"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lazy-loading 'pci_devices' on Instance uuid 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:27:20 user nova-compute[75326]:   <uuid>5378aa00-65c1-43c2-bbd5-0daf4e0e061f</uuid>
Dec 06 14:27:20 user nova-compute[75326]:   <name>instance-00000026</name>
Dec 06 14:27:20 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:27:20 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:27:20 user nova-compute[75326]:   <metadata>
Dec 06 14:27:20 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:27:20 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244</nova:name>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:27:20</nova:creationTime>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:27:20 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:27:20 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:owner>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:user uuid="883471c60ead40db9e148780c24291e8">tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member</nova:user>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:project uuid="8ef397319fcd4eb1a31fec14fa55847a">tempest-TestServerVolumeAttachScenarioOldVersion-473627157</nova:project>
Dec 06 14:27:20 user nova-compute[75326]:       </nova:owner>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:27:20 user nova-compute[75326]:       <nova:ports>
Dec 06 14:27:20 user nova-compute[75326]:         <nova:port uuid="1dbd6361-75b8-42c4-af85-c4758b0a553d">
Dec 06 14:27:20 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 14:27:20 user nova-compute[75326]:         </nova:port>
Dec 06 14:27:20 user nova-compute[75326]:       </nova:ports>
Dec 06 14:27:20 user nova-compute[75326]:     </nova:instance>
Dec 06 14:27:20 user nova-compute[75326]:   </metadata>
Dec 06 14:27:20 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:27:20 user nova-compute[75326]:     <system>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="serial">5378aa00-65c1-43c2-bbd5-0daf4e0e061f</entry>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="uuid">5378aa00-65c1-43c2-bbd5-0daf4e0e061f</entry>
Dec 06 14:27:20 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:27:20 user nova-compute[75326]:     </system>
Dec 06 14:27:20 user nova-compute[75326]:   </sysinfo>
Dec 06 14:27:20 user nova-compute[75326]:   <os>
Dec 06 14:27:20 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:27:20 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:27:20 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:27:20 user nova-compute[75326]:   </os>
Dec 06 14:27:20 user nova-compute[75326]:   <features>
Dec 06 14:27:20 user nova-compute[75326]:     <acpi/>
Dec 06 14:27:20 user nova-compute[75326]:     <apic/>
Dec 06 14:27:20 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:27:20 user nova-compute[75326]:   </features>
Dec 06 14:27:20 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:27:20 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:27:20 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:27:20 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:27:20 user nova-compute[75326]:   </clock>
Dec 06 14:27:20 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:27:20 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:27:20 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:27:20 user nova-compute[75326]:   </cpu>
Dec 06 14:27:20 user nova-compute[75326]:   <devices>
Dec 06 14:27:20 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:27:20 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:27:20 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk"/>
Dec 06 14:27:20 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:27:20 user nova-compute[75326]:     </disk>
Dec 06 14:27:20 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:27:20 user nova-compute[75326]:       <mac address="fa:16:3e:9d:5a:7d"/>
Dec 06 14:27:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:27:20 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:27:20 user nova-compute[75326]:       <target dev="tap1dbd6361-75"/>
Dec 06 14:27:20 user nova-compute[75326]:     </interface>
Dec 06 14:27:20 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:27:20 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/console.log" append="off"/>
Dec 06 14:27:20 user nova-compute[75326]:     </serial>
Dec 06 14:27:20 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:27:20 user nova-compute[75326]:     <video>
Dec 06 14:27:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:27:20 user nova-compute[75326]:     </video>
Dec 06 14:27:20 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:27:20 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:27:20 user nova-compute[75326]:     </rng>
Dec 06 14:27:20 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:27:20 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:27:20 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:27:20 user nova-compute[75326]:     </memballoon>
Dec 06 14:27:20 user nova-compute[75326]:   </devices>
Dec 06 14:27:20 user nova-compute[75326]: </domain>
Dec 06 14:27:20 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2146114',id=38,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXc2aoX7u1j4U9AZ5KVSxS2mkOtG0qJxIRoa9GErV4m3AHfOqh+olzd/ALoZ2uJ98Va5EYzKqDbjUyEdZDt0mdjR8WkTvFIh/Al0CMEyyyFbndAYh2VXGXgZYtP28aO8Q==',key_name='tempest-keypair-1666065403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef397319fcd4eb1a31fec14fa55847a',ramdisk_id='',reservation_id='r-pc6zot0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:27:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='883471c60ead40db9e148780c24291e8',uuid=5378aa00-65c1-43c2-bbd5-0daf4e0e061f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converting VIF {"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG os_vif [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd25ed119-79d6-52e9-967b-f5fd7ffdb9e7', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dbd6361-75, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dbd6361-75, col_values=(('qos', UUID('4da95555-daba-4461-9ce7-07d2ceda60c6')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dbd6361-75, col_values=(('external_ids', {'iface-id': '1dbd6361-75b8-42c4-af85-c4758b0a553d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:5a:7d', 'vm-uuid': '5378aa00-65c1-43c2-bbd5-0daf4e0e061f'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:20 user nova-compute[75326]: INFO os_vif [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75')
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:27:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] No VIF found with MAC fa:16:3e:9d:5a:7d, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:27:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updated VIF entry in instance network info cache for port 1dbd6361-75b8-42c4-af85-c4758b0a553d. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:27:21 user nova-compute[75326]: DEBUG nova.network.neutron [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updating instance_info_cache with network_info: [{"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-78539fb1-6fed-4862-9929-e882985e3d9e req-5435d949-45cf-40fc-b818-a17e681b9056 service nova] Releasing lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG nova.compute.manager [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] No waiting events found dispatching network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:22 user nova-compute[75326]: WARNING nova.compute.manager [req-0915ee5e-7565-4b1e-a432-23d8f50625cd req-7d3379f6-a062-4509-a77b-ae72392aee5e service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received unexpected event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d for instance with vm_state building and task_state spawning.
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:27:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Instance spawned successfully.
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:27:24 user nova-compute[75326]: INFO nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Took 5.36 seconds to spawn the instance on the hypervisor.
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:27:24 user nova-compute[75326]: INFO nova.compute.manager [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Took 6.01 seconds to build instance.
Dec 06 14:27:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-35379949-37bf-4bee-bdb4-18a9afd723db tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.110s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] No waiting events found dispatching network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:24 user nova-compute[75326]: WARNING nova.compute.manager [req-266054cf-69ee-49e2-99c9-5cb0a166e53b req-b2e0f605-e6ef-465c-af9d-b994d69919be service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received unexpected event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d for instance with vm_state active and task_state None.
Dec 06 14:27:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:27:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:39 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:41 user nova-compute[75326]: INFO nova.compute.manager [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Terminating instance
Dec 06 14:27:41 user nova-compute[75326]: DEBUG nova.compute.manager [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-unplugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-unplugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-31d6b173-c6b7-44f3-ad9c-bfad8d812922 req-876fc67f-21f7-443b-96c1-bc303ad65742 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-unplugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Instance destroyed successfully.
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lazy-loading 'resources' on Instance uuid ec544a60-1882-4092-ab63-7cdd85fe3108 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822867811',display_name='tempest-VolumesNegativeTest-instance-1822867811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822867811',id=36,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7f51378e044785aa5ad4e64cd5549f',ramdisk_id='',reservation_id='r-ppk0b04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1694769541',owner_user_name='tempest-VolumesNegativeTest-1694769541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:25:59Z,user_data=None,user_id='feb48b6dbd4d4ca7872004f70d8bd92e',uuid=ec544a60-1882-4092-ab63-7cdd85fe3108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converting VIF {"id": "3728c80c-50e6-434b-8c93-75bac00f8310", "address": "fa:16:3e:38:82:da", "network": {"id": "ac5cb540-3fa7-4f3b-b628-884e29d8b7db", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d8930b8b4524c469a40c067b22dcf2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3728c80c-50", "ovs_interfaceid": "3728c80c-50e6-434b-8c93-75bac00f8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG os_vif [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3728c80c-50, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b4ea4b4-2c51-466b-a228-8b88240be687) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: INFO os_vif [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:82:da,bridge_name='br-int',has_traffic_filtering=True,id=3728c80c-50e6-434b-8c93-75bac00f8310,network=Network(ac5cb540-3fa7-4f3b-b628-884e29d8b7db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3728c80c-50')
Dec 06 14:27:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Deleting instance files /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108_del
Dec 06 14:27:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Deletion of /opt/stack/data/nova/instances/ec544a60-1882-4092-ab63-7cdd85fe3108_del complete
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:42 user nova-compute[75326]: INFO nova.compute.manager [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Took 1.12 seconds to destroy the instance on the hypervisor.
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:27:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=7994MB free_disk=25.163970947265625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:43 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Took 0.72 seconds to deallocate network for instance.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 82db1a45-6725-46c9-9359-cf1b0cb90e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e7308382-95a1-4c2e-89e9-18462522bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ec544a60-1882-4092-ab63-7cdd85fe3108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.285s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state deleted and task_state None.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state deleted and task_state None.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state deleted and task_state None.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Acquiring lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] No waiting events found dispatching network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:27:43 user nova-compute[75326]: WARNING nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received unexpected event network-vif-plugged-3728c80c-50e6-434b-8c93-75bac00f8310 for instance with vm_state deleted and task_state None.
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.manager [req-fe58fb94-3447-4c94-80b0-b09a97373896 req-b7b7b346-31a1-4cd2-8165-ffd5aaf35e94 service nova] [instance: ec544a60-1882-4092-ab63-7cdd85fe3108] Received event network-vif-deleted-3728c80c-50e6-434b-8c93-75bac00f8310 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:43 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Deleted allocations for instance ec544a60-1882-4092-ab63-7cdd85fe3108
Dec 06 14:27:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-606c5787-950d-474d-a17a-524e00abaa57 tempest-VolumesNegativeTest-1694769541 tempest-VolumesNegativeTest-1694769541-project-member] Lock "ec544a60-1882-4092-ab63-7cdd85fe3108" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing instance network info cache due to event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updated VIF entry in instance network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG nova.network.neutron [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8ad91832-960d-4413-b098-c0cd493bc2ea req-dc68b3b1-7a77-49f6-8233-b7f9a0b83d60 service nova] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing instance network info cache due to event network-changed-9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] Acquiring lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] Acquired lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.network.neutron [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Refreshing network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:27:48 user nova-compute[75326]: INFO nova.compute.manager [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Detaching volume 9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:27:48 user nova-compute[75326]: INFO nova.virt.block_device [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Attempting to driver detach volume 9e86725c-787d-4559-896e-4e84fc238cef from mountpoint /dev/vdb
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Attempting to detach device vdb from instance e7308382-95a1-4c2e-89e9-18462522bdd5 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:27:48 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:27:48 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:27:48 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:27:48 user nova-compute[75326]:   <serial>9e86725c-787d-4559-896e-4e84fc238cef</serial>
Dec 06 14:27:48 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:27:48 user nova-compute[75326]: </disk>
Dec 06 14:27:48 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:27:48 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully detached device vdb from instance e7308382-95a1-4c2e-89e9-18462522bdd5 from the persistent domain config.
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7308382-95a1-4c2e-89e9-18462522bdd5 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:27:48 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:27:48 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:27:48 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:27:48 user nova-compute[75326]:   <serial>9e86725c-787d-4559-896e-4e84fc238cef</serial>
Dec 06 14:27:48 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:27:48 user nova-compute[75326]: </disk>
Dec 06 14:27:48 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.network.neutron [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updated VIF entry in instance network info cache for port 9eb63748-c0e6-4646-a98d-da18447b0055. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.network.neutron [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [{"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bc8b1be-1662-409a-b578-9a52cb02b632 req-7f2215ed-c4e8-4e64-96c0-2e3e46758adc service nova] Releasing lock "refresh_cache-e7308382-95a1-4c2e-89e9-18462522bdd5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:27:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:27:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:49 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:27:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:27:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:27:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:27:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:02 user nova-compute[75326]: INFO nova.compute.manager [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Terminating instance
Dec 06 14:28:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0fb4182f-7a70-404e-93c1-c8cbc62d1db9 req-c84177cf-6817-4557-b5fb-1248a6cc7382 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-unplugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:28:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Instance destroyed successfully.
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid 82db1a45-6725-46c9-9359-cf1b0cb90e65 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-786413736',display_name='tempest-ServerRescueNegativeTestJSON-server-786413736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-786413736',id=19,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-aizogry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:13:44Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=82db1a45-6725-46c9-9359-cf1b0cb90e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "address": "fa:16:3e:e7:8b:25", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a2b804-ac", "ovs_interfaceid": "e8a2b804-acb0-429f-bfbc-3b0db45e811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG os_vif [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a2b804-ac, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0144ba3-079b-4c22-8de6-e6ed6dbac4ef) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:03 user nova-compute[75326]: INFO os_vif [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=e8a2b804-acb0-429f-bfbc-3b0db45e811d,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a2b804-ac')
Dec 06 14:28:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Deleting instance files /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65_del
Dec 06 14:28:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Deletion of /opt/stack/data/nova/instances/82db1a45-6725-46c9-9359-cf1b0cb90e65_del complete
Dec 06 14:28:03 user nova-compute[75326]: INFO nova.compute.manager [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 14:28:03 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:28:03 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Took 0.44 seconds to deallocate network for instance.
Dec 06 14:28:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-08ba42c0-b3a4-4b21-8951-725302d658a9 req-f5ceb5b4-9832-4f76-875a-d698ddd4a166 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-deleted-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:28:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:04 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Deleted allocations for instance 82db1a45-6725-46c9-9359-cf1b0cb90e65
Dec 06 14:28:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3488313a-aec3-4922-b196-81534265bc20 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.971s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] Acquiring lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] Lock "82db1a45-6725-46c9-9359-cf1b0cb90e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] No waiting events found dispatching network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:05 user nova-compute[75326]: WARNING nova.compute.manager [req-b6987ee9-07c5-40fe-94b6-64754ea95ce8 req-85d64dd5-a75c-4abd-9604-24b0ee117557 service nova] [instance: 82db1a45-6725-46c9-9359-cf1b0cb90e65] Received unexpected event network-vif-plugged-e8a2b804-acb0-429f-bfbc-3b0db45e811d for instance with vm_state deleted and task_state None.
Dec 06 14:28:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e7308382-95a1-4c2e-89e9-18462522bdd5 is timed out.
Dec 06 14:28:08 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully detached device vdb from instance e7308382-95a1-4c2e-89e9-18462522bdd5 from the live domain config.
Dec 06 14:28:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQuPBXti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:28:08 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152c5f5-a5c5-4308-a6a5-3f2b84079d8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:28:08 user nova-compute[75326]: No targets found.
Dec 06 14:28:08 user nova-compute[75326]: iSNS:
Dec 06 14:28:08 user nova-compute[75326]: No targets found.
Dec 06 14:28:08 user nova-compute[75326]: STATIC:
Dec 06 14:28:08 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef
Dec 06 14:28:08 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:28:08 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:28:08 user nova-compute[75326]: FIRMWARE:
Dec 06 14:28:08 user nova-compute[75326]: No targets found.
Dec 06 14:28:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:28:08 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:28:08 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf0910-f4b0-469b-8014-39a5fdc4b999]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[116331cd-9ad4-468d-8ecb-3dae58678bde]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:28:09 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef (non-flash)
Dec 06 14:28:09 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce8e5cb-985f-40e7-8c61-13a7641492df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15a5c70-889f-4b52-9df1-745fc5ec4963]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488f3fe-ead1-4d23-8f62-688d810ac501]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[62324849-7b34-4e0b-9381-71d378d1b710]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec0e9eb-7e45-426e-a1d8-014f8d7ac3c3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f384f7e7-8240-4b9a-b6aa-b52d05a13798]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260]
Dec 06 14:28:09 user nova-compute[75326]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef, portal: 172.16.0.220,3260] successful.
Dec 06 14:28:09 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e86725c-787d-4559-896e-4e84fc238cef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b66cf8-0420-4672-9dcc-07dbe82e89b2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] <== disconnect_volume: return (327ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:28:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:28:10 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'flavor' on Instance uuid e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:28:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1068e76-d8f7-465f-8c9e-49b1feede3d1 tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:28:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:28:24 user nova-compute[75326]: INFO nova.compute.claims [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Claim successful on node user
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:28:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.policy [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584d6786de6449e7b07e35ca2a0a2291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea056f8f4348118fce811a5b38bbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:28:24 user nova-compute[75326]: INFO nova.virt.block_device [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Booting with volume 46cd1d9e-26d5-4aaf-860c-8f80190687c7 at /dev/vda
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.utils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd6538c-a1a5-4b3e-96ac-d78a785c4b40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fe7857-c708-45e3-8609-bbe290849c3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1e7b6-1b5c-41de-a929-a1df783ae990]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f4139-9b00-40a5-8139-1a6c385aa8c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:28:24 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:28:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e407f-189c-4412-bcee-7e61bd8df6f1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG os_brick.utils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:28:24 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating existing volume attachment record: 969bd017-9b3e-4909-906a-cb624ef3c993 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Successfully created port: 37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Successfully updated port: 37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-changed-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Refreshing instance network info cache due to event network-changed-37473d08-ec2d-4ca7-8e54-25552f2d5356. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:28:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance network_info: |[{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Refreshing network info cache for port 37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updated VIF entry in instance network info cache for port 37473d08-ec2d-4ca7-8e54-25552f2d5356. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG nova.network.neutron [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:28:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7441009a-3245-4450-ae37-eaec8f3b50da req-6655e201-a6fa-47ba-b22b-bce30fea129f service nova] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:28:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:28:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Creating image(s)
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start _get_guest_xml network_info=[{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '969bd017-9b3e-4909-906a-cb624ef3c993', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3926e02-a7c3-4831-a548-8e1ec2cb5e3d', 'attached_at': '', 'detached_at': '', 'volume_id': '46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'serial': '46cd1d9e-26d5-4aaf-860c-8f80190687c7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:28:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:28:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:28:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:28:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:28:34 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a90be1-4a86-49b9-926e-1d114ab9df17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:28:34 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdac72-0f2a-4856-a3f9-c1e99fad7016]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7] added
Dec 06 14:28:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd9a0d-68db-412e-b9ca-5e3312ef59d4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb33bd1-6a57-4359-b78c-3234cda8751c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woKbZRDm {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woKbZRDm" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c2ed37-c303-4272-886d-78821b148acf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woKbZRDm'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[50242f23-dd99-4e17-8abb-52b983262ab6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9104ff-0d54-4141-9269-ab3375c7d65c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:28:34 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:28:34 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:28:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 14:28:34 user nova-compute[75326]: 
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda5ed3-769e-441c-8e15-1f49216c7aca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]
Dec 06 14:28:34 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.
Dec 06 14:28:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef512b4-656b-4c74-bcd6-dfcedd5a141c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9fa01-04b9-4cd3-a708-2fa1278621ad]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:28:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:28:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75492c-21ca-4277-92e0-9fcd062192b7]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:28:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26661333538626563', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333538626563', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'pci_devices' on Instance uuid f3926e02-a7c3-4831-a548-8e1ec2cb5e3d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:28:35 user nova-compute[75326]:   <uuid>f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</uuid>
Dec 06 14:28:35 user nova-compute[75326]:   <name>instance-00000027</name>
Dec 06 14:28:35 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:28:35 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:28:35 user nova-compute[75326]:   <metadata>
Dec 06 14:28:35 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:28:35 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:28:35 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherA-server-586265264</nova:name>
Dec 06 14:28:35 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:28:34</nova:creationTime>
Dec 06 14:28:35 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:28:35 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:28:35 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:28:35 user nova-compute[75326]:       <nova:owner>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:user uuid="584d6786de6449e7b07e35ca2a0a2291">tempest-ServerActionsTestOtherA-1568176033-project-member</nova:user>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:project uuid="fcea056f8f4348118fce811a5b38bbe3">tempest-ServerActionsTestOtherA-1568176033</nova:project>
Dec 06 14:28:35 user nova-compute[75326]:       </nova:owner>
Dec 06 14:28:35 user nova-compute[75326]:       <nova:ports>
Dec 06 14:28:35 user nova-compute[75326]:         <nova:port uuid="37473d08-ec2d-4ca7-8e54-25552f2d5356">
Dec 06 14:28:35 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 14:28:35 user nova-compute[75326]:         </nova:port>
Dec 06 14:28:35 user nova-compute[75326]:       </nova:ports>
Dec 06 14:28:35 user nova-compute[75326]:     </nova:instance>
Dec 06 14:28:35 user nova-compute[75326]:   </metadata>
Dec 06 14:28:35 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:28:35 user nova-compute[75326]:     <system>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="serial">f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</entry>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="uuid">f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</entry>
Dec 06 14:28:35 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:28:35 user nova-compute[75326]:     </system>
Dec 06 14:28:35 user nova-compute[75326]:   </sysinfo>
Dec 06 14:28:35 user nova-compute[75326]:   <os>
Dec 06 14:28:35 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:28:35 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:28:35 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:28:35 user nova-compute[75326]:   </os>
Dec 06 14:28:35 user nova-compute[75326]:   <features>
Dec 06 14:28:35 user nova-compute[75326]:     <acpi/>
Dec 06 14:28:35 user nova-compute[75326]:     <apic/>
Dec 06 14:28:35 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:28:35 user nova-compute[75326]:   </features>
Dec 06 14:28:35 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:28:35 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:28:35 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:28:35 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:28:35 user nova-compute[75326]:   </clock>
Dec 06 14:28:35 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:28:35 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:28:35 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:28:35 user nova-compute[75326]:   </cpu>
Dec 06 14:28:35 user nova-compute[75326]:   <devices>
Dec 06 14:28:35 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:28:35 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:28:35 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:28:35 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:28:35 user nova-compute[75326]:       <serial>46cd1d9e-26d5-4aaf-860c-8f80190687c7</serial>
Dec 06 14:28:35 user nova-compute[75326]:     </disk>
Dec 06 14:28:35 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:28:35 user nova-compute[75326]:       <mac address="fa:16:3e:ff:b4:2b"/>
Dec 06 14:28:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:28:35 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:28:35 user nova-compute[75326]:       <target dev="tap37473d08-ec"/>
Dec 06 14:28:35 user nova-compute[75326]:     </interface>
Dec 06 14:28:35 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:28:35 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d/console.log" append="off"/>
Dec 06 14:28:35 user nova-compute[75326]:     </serial>
Dec 06 14:28:35 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:28:35 user nova-compute[75326]:     <video>
Dec 06 14:28:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:28:35 user nova-compute[75326]:     </video>
Dec 06 14:28:35 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:28:35 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:28:35 user nova-compute[75326]:     </rng>
Dec 06 14:28:35 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:28:35 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:28:35 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:28:35 user nova-compute[75326]:     </memballoon>
Dec 06 14:28:35 user nova-compute[75326]:   </devices>
Dec 06 14:28:35 user nova-compute[75326]: </domain>
Dec 06 14:28:35 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG os_vif [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a65d252-0c5d-514a-b75d-f87a945ee61c', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37473d08-ec, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37473d08-ec, col_values=(('qos', UUID('321ba217-3f00-4dc9-9ace-b3d669018a73')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37473d08-ec, col_values=(('external_ids', {'iface-id': '37473d08-ec2d-4ca7-8e54-25552f2d5356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b4:2b', 'vm-uuid': 'f3926e02-a7c3-4831-a548-8e1ec2cb5e3d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:35 user nova-compute[75326]: INFO os_vif [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec')
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:28:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:ff:b4:2b, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:28:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:37 user nova-compute[75326]: WARNING nova.compute.manager [req-e4869678-ade5-4663-8521-d8a3ce84b738 req-9c461f30-1751-4feb-9e89-8a6d00d1cc59 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state building and task_state spawning.
Dec 06 14:28:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:28:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance spawned successfully.
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:28:39 user nova-compute[75326]: INFO nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Took 4.89 seconds to spawn the instance on the hypervisor.
Dec 06 14:28:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:39 user nova-compute[75326]: WARNING nova.compute.manager [req-f675944c-72bf-41fc-8ce9-40a0d79ee514 req-0134476f-a658-479f-9dce-be2bd17ae133 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state building and task_state spawning.
Dec 06 14:28:39 user nova-compute[75326]: INFO nova.compute.manager [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Took 15.05 seconds to build instance.
Dec 06 14:28:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-14f6243c-93f0-45dc-86bf-bfde8480ca11 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.148s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:41 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:28:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:28:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:28:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8385MB free_disk=25.207355499267578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:44 user nova-compute[75326]: INFO nova.compute.manager [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Terminating instance
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a1572caf-4d57-4c7c-9250-636f19bfb73a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance e7308382-95a1-4c2e-89e9-18462522bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-ad77e0cb-26d2-4bab-8481-4246be0b742d req-50e2e5aa-ed56-4916-ac78-07287a2de0f9 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-unplugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:28:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Instance destroyed successfully.
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lazy-loading 'resources' on Instance uuid e7308382-95a1-4c2e-89e9-18462522bdd5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-539430336',display_name='tempest-TestMinimumBasicScenario-server-539430336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-539430336',id=35,image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHboxhgN8XKVoBi+OEwP8lCZidMKQJMgQC3txQKGMj65FkWfx9Hg8CSdICqUqhvZ7oqXsm/dD0HImU98Nk5tIuIMt2ePkDgiPJiLbQ1F/N9/v0ekNwKUrDXKO3wqaeGTYA==',key_name='tempest-TestMinimumBasicScenario-326950416',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e022afe38348fd87bc8b16175e1f09',ramdisk_id='',reservation_id='r-x1i4eev4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42db6404-9b71-460e-9d91-d0f264824ec5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1988051507',owner_user_name='tempest-TestMinimumBasicScenario-1988051507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:26:03Z,user_data=None,user_id='c053c2d147df4c959d5cffa31dc2490c',uuid=e7308382-95a1-4c2e-89e9-18462522bdd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converting VIF {"id": "9eb63748-c0e6-4646-a98d-da18447b0055", "address": "fa:16:3e:06:2e:94", "network": {"id": "b524d8a0-fdb1-4e8e-a93e-1486b2ee2472", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1867882802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e022afe38348fd87bc8b16175e1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb63748-c0", "ovs_interfaceid": "9eb63748-c0e6-4646-a98d-da18447b0055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG os_vif [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eb63748-c0, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e54c36b7-7ae6-4db7-bea5-fa76b2248787) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:45 user nova-compute[75326]: INFO os_vif [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=9eb63748-c0e6-4646-a98d-da18447b0055,network=Network(b524d8a0-fdb1-4e8e-a93e-1486b2ee2472),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb63748-c0')
Dec 06 14:28:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Deleting instance files /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5_del
Dec 06 14:28:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Deletion of /opt/stack/data/nova/instances/e7308382-95a1-4c2e-89e9-18462522bdd5_del complete
Dec 06 14:28:45 user nova-compute[75326]: INFO nova.compute.manager [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 06 14:28:45 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:28:45 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Took 0.41 seconds to deallocate network for instance.
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bf54b0c-4b84-4891-bd85-63790e0eae18 req-5227051e-5960-4099-aab0-602585165461 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-deleted-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:28:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:46 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Deleted allocations for instance e7308382-95a1-4c2e-89e9-18462522bdd5
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4b4388a1-f906-40f9-9cbb-b38a920982ff tempest-TestMinimumBasicScenario-1988051507 tempest-TestMinimumBasicScenario-1988051507-project-member] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] Acquiring lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] Lock "e7308382-95a1-4c2e-89e9-18462522bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] No waiting events found dispatching network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:46 user nova-compute[75326]: WARNING nova.compute.manager [req-ee6a181e-ee1d-462c-b79d-d799f2996a75 req-f082335c-6984-4d6f-8419-30871b893c16 service nova] [instance: e7308382-95a1-4c2e-89e9-18462522bdd5] Received unexpected event network-vif-plugged-9eb63748-c0e6-4646-a98d-da18447b0055 for instance with vm_state deleted and task_state None.
Dec 06 14:28:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:28:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:53 user nova-compute[75326]: INFO nova.compute.manager [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Terminating instance
Dec 06 14:28:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-76a3d5d7-91cb-49c8-9164-6e0d307bec35 req-f38b8112-ea3e-4a99-a17f-6e604f483ea4 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-unplugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Instance destroyed successfully.
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lazy-loading 'resources' on Instance uuid a1572caf-4d57-4c7c-9250-636f19bfb73a {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-39709060',display_name='tempest-ServerRescueNegativeTestJSON-server-39709060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-39709060',id=18,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86cdbc282e0a4495b38e0383600b8363',ramdisk_id='',reservation_id='r-stsi9yrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1889348723',owner_user_name='tempest-ServerRescueNegativeTestJSON-1889348723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:18:29Z,user_data=None,user_id='779267c6564b43c293a1025a9c575b13',uuid=a1572caf-4d57-4c7c-9250-636f19bfb73a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converting VIF {"id": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "address": "fa:16:3e:97:3a:8c", "network": {"id": "13be4e07-60af-4619-af6d-2c4bacf00593", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-604563183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86cdbc282e0a4495b38e0383600b8363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a16eb4e-37", "ovs_interfaceid": "6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG os_vif [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a16eb4e-37, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10b2cd72-64d6-44d2-8ffa-7f9718be8f0c) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:54 user nova-compute[75326]: INFO os_vif [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:3a:8c,bridge_name='br-int',has_traffic_filtering=True,id=6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7,network=Network(13be4e07-60af-4619-af6d-2c4bacf00593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a16eb4e-37')
Dec 06 14:28:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Deleting instance files /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a_del
Dec 06 14:28:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Deletion of /opt/stack/data/nova/instances/a1572caf-4d57-4c7c-9250-636f19bfb73a_del complete
Dec 06 14:28:54 user nova-compute[75326]: INFO nova.compute.manager [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Took 1.11 seconds to destroy the instance on the hypervisor.
Dec 06 14:28:54 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:28:54 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Took 0.56 seconds to deallocate network for instance.
Dec 06 14:28:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:55 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Deleted allocations for instance a1572caf-4d57-4c7c-9250-636f19bfb73a
Dec 06 14:28:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-883e28de-9e37-4eea-9bec-ca4a13864b84 tempest-ServerRescueNegativeTestJSON-1889348723 tempest-ServerRescueNegativeTestJSON-1889348723-project-member] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] Acquiring lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] Lock "a1572caf-4d57-4c7c-9250-636f19bfb73a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:28:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] No waiting events found dispatching network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:28:55 user nova-compute[75326]: WARNING nova.compute.manager [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received unexpected event network-vif-plugged-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 for instance with vm_state deleted and task_state None.
Dec 06 14:28:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-95efcb49-6cb5-43df-b6c1-504c7db16e03 req-dbfe6128-6108-4801-b02c-d03e55cabd70 service nova] [instance: a1572caf-4d57-4c7c-9250-636f19bfb73a] Received event network-vif-deleted-6a16eb4e-37f1-4a69-8f6f-d4a0f07d97f7 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:28:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:28:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-changed-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Refreshing instance network info cache due to event network-changed-0ef135bd-9db1-4c64-968f-810cebf05dc6. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] Acquiring lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] Acquired lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Refreshing network info cache for port 0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:01 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Ignoring supplied device name: /dev/vdb
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updated VIF entry in instance network info cache for port 0ef135bd-9db1-4c64-968f-810cebf05dc6. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updating instance_info_cache with network_info: [{"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-146a3629-0d01-40e8-97cf-d0028e88c7eb req-b2621e21-0d46-4422-be85-ab5d0a231384 service nova] Releasing lock "refresh_cache-49dcd579-59ad-4cf9-a2bf-6114e66a5921" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:01 user nova-compute[75326]: INFO nova.compute.manager [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Attaching volume bb636c25-3f7c-49bf-b9f5-232d35b64fd0 to /dev/vdb
Dec 06 14:29:01 user nova-compute[75326]: DEBUG os_brick.utils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d44bfd-0984-49f6-a7f2-d5de297bd045]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c0cebb-ab64-4532-a7ea-3bbd9bac695f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cbcf2b-be93-41eb-b684-a623a6fefecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccacd2b1-38b9-439f-9353-cde9281fb0de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:02 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:29:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[824da8f4-115f-488b-9443-c97c25bc53d1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG os_brick.utils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:02 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updating existing volume attachment record: 39472941-bb4c-4d40-a434-d796ca0823bb {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:29:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:29:05 user nova-compute[75326]: INFO nova.compute.claims [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Claim successful on node user
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:29:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:29:05 user nova-compute[75326]: INFO nova.virt.block_device [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Booting with volume 4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd at /dev/vda
Dec 06 14:29:05 user nova-compute[75326]: DEBUG nova.policy [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deb48db836b440bfa0c5ba816cedbe46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d83ca71f343968cfce19b49178fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG os_brick.utils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4552bb88-cb19-424f-8d67-e019a2ed1954]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f1c09-7ca3-4d67-80a1-cb5fd5cb1270]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2823c03-9ef0-4bdc-a97b-d1f4456662e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b369074-936d-4f5c-8e54-2fa07631ddf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:06 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:29:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d21f3-9bff-40b8-8378-f3acf6811784]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG os_brick.utils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating existing volume attachment record: 8902965f-1062-46c1-b96c-740d7df87156 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:29:06 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Successfully created port: 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Successfully updated port: 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing instance network info cache due to event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance network_info: |[{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updated VIF entry in instance network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG nova.network.neutron [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:29:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8178080c-c087-44a8-b42a-a6a97fbd4592 req-3962296d-bb10-428a-a532-cbef0b4c6502 service nova] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG nova.compute.manager [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-changed-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG nova.compute.manager [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Refreshing instance network info cache due to event network-changed-1dbd6361-75b8-42c4-af85-c4758b0a553d. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] Acquiring lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] Acquired lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:29:09 user nova-compute[75326]: DEBUG nova.network.neutron [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Refreshing network info cache for port 1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:29:10 user nova-compute[75326]: DEBUG nova.network.neutron [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updated VIF entry in instance network info cache for port 1dbd6361-75b8-42c4-af85-c4758b0a553d. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:29:10 user nova-compute[75326]: DEBUG nova.network.neutron [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updating instance_info_cache with network_info: [{"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:29:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-42551762-6f10-4699-ac69-5bae1d0c7b5f req-a8630853-f7c5-4a3a-b3ee-e12ec9059427 service nova] Releasing lock "refresh_cache-5378aa00-65c1-43c2-bbd5-0daf4e0e061f" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMkyFwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:12 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f315ae-5b86-4037-b474-d8f6ec1bc28c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:29:12 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[081fb105-c249-4344-ad06-4c49c6b3039d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0] added
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[696772fd-fe19-40c6-974f-7e6d014700c1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27753f-de7d-459e-92fa-b9561c3a24fa]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrMkyFwS {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrMkyFwS" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bb421a-20f7-4e30-86c4-2db968dbbc21]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrMkyFwS'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87c45c-9efb-478a-92a9-72f1037c1d35]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a8160b-d754-4883-b26e-6b915aec6e41]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85f137-8857-4ba9-8cf7-027f714de978]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260]
Dec 06 14:29:12 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260] successful.
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc57dc-02f6-4aea-8810-b2a9eb20cafc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0953a1b0-3db4-4bed-9ec5-41fe596e34db]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e10562-4ba5-4d85-85b1-a1b0dddb3bee]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:29:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMkyFwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:29:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23433623734313062', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433623734313062', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:29:13 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:29:13 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:13 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:29:13 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:13 user nova-compute[75326]:   <serial>bb636c25-3f7c-49bf-b9f5-232d35b64fd0</serial>
Dec 06 14:29:13 user nova-compute[75326]: </disk>
Dec 06 14:29:13 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lazy-loading 'flavor' on Instance uuid 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] No VIF found with MAC fa:16:3e:0a:9c:b6, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:14 user nova-compute[75326]: INFO nova.compute.manager [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Attaching volume 4fb25b16-675b-4e63-ac20-31a7c16ad77f to /dev/vdb
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.utils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fbdec9-2407-4800-8915-87a1f74b8de6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a3b59-28f3-47a1-8e45-db7f0da488e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8623d587-34b2-4c94-b9a2-3a4a6420b298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f838d385-18df-4e0a-9489-a4cb6b3c8ccd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6966b1e4-1617-4327-98ee-aaffda28b153 tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.780s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:29:14 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:29:14 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8666653e-365c-4a4d-a1a6-b3439e5a546d]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG os_brick.utils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:14 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updating existing volume attachment record: fd1f01fc-88d9-48c6-97a9-665cf7b97384 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:29:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Creating image(s)
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Ensure instance console log exists: /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start _get_guest_xml network_info=[{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '8902965f-1062-46c1-b96c-740d7df87156', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef56e0e8-3dbe-4df9-8c54-b431111dcd01', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'serial': '4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:29:16 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:29:16 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:16 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:16 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51886c4d-dc48-4896-b77e-071c233f97fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:29:16 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89483ce6-b699-4456-b7fe-1b8b4bb8db54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd] added
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8628cf3a-64e7-4b8e-95bf-ae4dadc9e706]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7049383-3e54-45ff-be95-f7919538b1d5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v begqnOAp {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v begqnOAp" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef9a0c-bf1f-42d4-99d0-e8078dd8506b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'begqnOAp'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bc7cf-fcb3-482f-a8df-6a026947e9c7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e55c89-f681-4d04-ac45-f299ea33829e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e38a902-862f-4a28-bcf3-62e5dfc49f7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]
Dec 06 14:29:16 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8bab91-afc7-468f-9543-5fcaca1857c4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5951699a-fc64-4fb0-876a-76972fc6e1fc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:16 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:16 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12087faf-c884-4dc4-8982-c83cac6b1193]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:29:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23237646532306362', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237646532306362', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMXWpQJz31SCBsHnmFwAo2hyPmOqIik03FnFgc6Cm6LuIp8zHAoVkA7V1tUH644LBBghnT8UD14KPC+wo5x1sO8rcQ7Kmy8qL2VvFr8/xcO2r9H640dZzFMiM8xrP7OUA==',key_name='tempest-TestShelveInstance-760153415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:29:06Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'pci_devices' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:29:17 user nova-compute[75326]:   <uuid>ef56e0e8-3dbe-4df9-8c54-b431111dcd01</uuid>
Dec 06 14:29:17 user nova-compute[75326]:   <name>instance-00000028</name>
Dec 06 14:29:17 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:29:17 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:29:17 user nova-compute[75326]:   <metadata>
Dec 06 14:29:17 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:29:17 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:29:17 user nova-compute[75326]:       <nova:name>tempest-TestShelveInstance-server-608812256</nova:name>
Dec 06 14:29:17 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:29:16</nova:creationTime>
Dec 06 14:29:17 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:29:17 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:29:17 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:29:17 user nova-compute[75326]:       <nova:owner>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:user uuid="deb48db836b440bfa0c5ba816cedbe46">tempest-TestShelveInstance-476323943-project-member</nova:user>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:project uuid="b99d83ca71f343968cfce19b49178fe6">tempest-TestShelveInstance-476323943</nova:project>
Dec 06 14:29:17 user nova-compute[75326]:       </nova:owner>
Dec 06 14:29:17 user nova-compute[75326]:       <nova:ports>
Dec 06 14:29:17 user nova-compute[75326]:         <nova:port uuid="410384c4-8b2c-4aba-add4-e7be99c32197">
Dec 06 14:29:17 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:29:17 user nova-compute[75326]:         </nova:port>
Dec 06 14:29:17 user nova-compute[75326]:       </nova:ports>
Dec 06 14:29:17 user nova-compute[75326]:     </nova:instance>
Dec 06 14:29:17 user nova-compute[75326]:   </metadata>
Dec 06 14:29:17 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:29:17 user nova-compute[75326]:     <system>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="serial">ef56e0e8-3dbe-4df9-8c54-b431111dcd01</entry>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="uuid">ef56e0e8-3dbe-4df9-8c54-b431111dcd01</entry>
Dec 06 14:29:17 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:29:17 user nova-compute[75326]:     </system>
Dec 06 14:29:17 user nova-compute[75326]:   </sysinfo>
Dec 06 14:29:17 user nova-compute[75326]:   <os>
Dec 06 14:29:17 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:29:17 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:29:17 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:29:17 user nova-compute[75326]:   </os>
Dec 06 14:29:17 user nova-compute[75326]:   <features>
Dec 06 14:29:17 user nova-compute[75326]:     <acpi/>
Dec 06 14:29:17 user nova-compute[75326]:     <apic/>
Dec 06 14:29:17 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:29:17 user nova-compute[75326]:   </features>
Dec 06 14:29:17 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:29:17 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:29:17 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:29:17 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:29:17 user nova-compute[75326]:   </clock>
Dec 06 14:29:17 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:29:17 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:29:17 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:29:17 user nova-compute[75326]:   </cpu>
Dec 06 14:29:17 user nova-compute[75326]:   <devices>
Dec 06 14:29:17 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:29:17 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:17 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:29:17 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:29:17 user nova-compute[75326]:       <serial>4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd</serial>
Dec 06 14:29:17 user nova-compute[75326]:     </disk>
Dec 06 14:29:17 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:29:17 user nova-compute[75326]:       <mac address="fa:16:3e:0b:7b:89"/>
Dec 06 14:29:17 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:29:17 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:29:17 user nova-compute[75326]:       <target dev="tap410384c4-8b"/>
Dec 06 14:29:17 user nova-compute[75326]:     </interface>
Dec 06 14:29:17 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:29:17 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01/console.log" append="off"/>
Dec 06 14:29:17 user nova-compute[75326]:     </serial>
Dec 06 14:29:17 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:29:17 user nova-compute[75326]:     <video>
Dec 06 14:29:17 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:29:17 user nova-compute[75326]:     </video>
Dec 06 14:29:17 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:29:17 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:29:17 user nova-compute[75326]:     </rng>
Dec 06 14:29:17 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:29:17 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:29:17 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:29:17 user nova-compute[75326]:     </memballoon>
Dec 06 14:29:17 user nova-compute[75326]:   </devices>
Dec 06 14:29:17 user nova-compute[75326]: </domain>
Dec 06 14:29:17 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMXWpQJz31SCBsHnmFwAo2hyPmOqIik03FnFgc6Cm6LuIp8zHAoVkA7V1tUH644LBBghnT8UD14KPC+wo5x1sO8rcQ7Kmy8qL2VvFr8/xcO2r9H640dZzFMiM8xrP7OUA==',key_name='tempest-TestShelveInstance-760153415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:29:06Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG os_vif [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60faec6e-c863-5202-9161-4f04d131f5d1', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap410384c4-8b, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap410384c4-8b, col_values=(('qos', UUID('b7b25299-0614-4db6-9dd4-7ddbd0d0b924')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap410384c4-8b, col_values=(('external_ids', {'iface-id': '410384c4-8b2c-4aba-add4-e7be99c32197', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:7b:89', 'vm-uuid': 'ef56e0e8-3dbe-4df9-8c54-b431111dcd01'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:17 user nova-compute[75326]: INFO os_vif [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b')
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:29:17 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] No VIF found with MAC fa:16:3e:0b:7b:89, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:29:19 user nova-compute[75326]: WARNING nova.compute.manager [req-9bef4efa-abe6-48cf-8bcc-93b52dacec13 req-4f1451d1-a5a5-44b8-9fbf-f6c01d2f3096 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state building and task_state spawning.
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:29:21 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance spawned successfully.
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:29:21 user nova-compute[75326]: INFO nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Took 5.09 seconds to spawn the instance on the hypervisor.
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:29:21 user nova-compute[75326]: WARNING nova.compute.manager [req-88edc5c6-c199-4a15-8eca-f5b20b4e8661 req-087b221f-27fa-414e-972a-f14e29094dfb service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state building and task_state spawning.
Dec 06 14:29:21 user nova-compute[75326]: INFO nova.compute.manager [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Took 16.10 seconds to build instance.
Dec 06 14:29:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b80c2c54-72e3-4d3a-b59f-ba5919969348 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.214s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYclqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:24 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:24 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:24 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b81d7-5cf1-44f7-a0f7-d96e58006e03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:29:24 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f5b9b-6873-4fcc-90e9-05dfd6f56da8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f] added
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe78a7-00db-4839-b8d9-032c0dbb53a3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6340e24-72c7-479b-8acb-7048927405e1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYclqJa {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYclqJa" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd72f5-5eb9-4b1c-aecd-a371f3b56ec1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtYclqJa'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbcddd1-e433-4c46-bc8a-ad7a5e128bba]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cee694-41b8-483d-85c8-fdd526e01f0b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71843e-1c3c-4610-947f-0e031afc18e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260]
Dec 06 14:29:24 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260] successful.
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebde95a-4e69-4bda-8126-479151b27264]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67313f4c-14fe-479b-8b3f-7903669fc235]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:24 user nova-compute[75326]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)
Dec 06 14:29:24 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba1f06-4801-4e9e-875d-5ed6df55bc4f]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:29:24 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYclqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:29:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23734303237616664', 'path': '/dev/sde'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734303237616664', 'path': '/dev/sde'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:29:25 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lazy-loading 'flavor' on Instance uuid 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:29:25 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:25 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:29:25 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:25 user nova-compute[75326]:   <serial>4fb25b16-675b-4e63-ac20-31a7c16ad77f</serial>
Dec 06 14:29:25 user nova-compute[75326]: </disk>
Dec 06 14:29:25 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:29:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:29:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:29:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] No VIF found with MAC fa:16:3e:9d:5a:7d, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:29:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e146b95e-adcd-4092-9863-a25b5103825b tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.140s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:28 user nova-compute[75326]: INFO nova.compute.manager [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Detaching volume 4fb25b16-675b-4e63-ac20-31a7c16ad77f
Dec 06 14:29:28 user nova-compute[75326]: INFO nova.virt.block_device [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Attempting to driver detach volume 4fb25b16-675b-4e63-ac20-31a7c16ad77f from mountpoint /dev/vdb
Dec 06 14:29:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Attempting to detach device vdb from instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:29:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:29:28 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:28 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:29:28 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:28 user nova-compute[75326]:   <serial>4fb25b16-675b-4e63-ac20-31a7c16ad77f</serial>
Dec 06 14:29:28 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:29:28 user nova-compute[75326]: </disk>
Dec 06 14:29:28 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:29:28 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Successfully detached device vdb from instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f from the persistent domain config.
Dec 06 14:29:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:29:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:29:28 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:28 user nova-compute[75326]:   <source dev="/dev/sde"/>
Dec 06 14:29:28 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:28 user nova-compute[75326]:   <serial>4fb25b16-675b-4e63-ac20-31a7c16ad77f</serial>
Dec 06 14:29:28 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:29:28 user nova-compute[75326]: </disk>
Dec 06 14:29:28 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:29:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:29:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:36 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:39 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:29:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:41 user nova-compute[75326]: INFO nova.compute.manager [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Detaching volume bb636c25-3f7c-49bf-b9f5-232d35b64fd0
Dec 06 14:29:41 user nova-compute[75326]: INFO nova.virt.block_device [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Attempting to driver detach volume bb636c25-3f7c-49bf-b9f5-232d35b64fd0 from mountpoint /dev/vdb
Dec 06 14:29:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Attempting to detach device vdb from instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:29:41 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:41 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:29:41 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:41 user nova-compute[75326]:   <serial>bb636c25-3f7c-49bf-b9f5-232d35b64fd0</serial>
Dec 06 14:29:41 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:29:41 user nova-compute[75326]: </disk>
Dec 06 14:29:41 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:29:41 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully detached device vdb from instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 from the persistent domain config.
Dec 06 14:29:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:29:41 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:29:41 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:29:41 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:29:41 user nova-compute[75326]:   <serial>bb636c25-3f7c-49bf-b9f5-232d35b64fd0</serial>
Dec 06 14:29:41 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:29:41 user nova-compute[75326]: </disk>
Dec 06 14:29:41 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:41 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:29:44 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8322MB free_disk=25.298690795898438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ef56e0e8-3dbe-4df9-8c54-b431111dcd01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:29:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Skipping network cache update for instance because it is being deleted. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:29:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:46 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:29:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:29:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:29:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:48 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f is timed out.
Dec 06 14:29:48 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Successfully detached device vdb from instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f from the live domain config.
Dec 06 14:29:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYclqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:29:48 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b4a91-54af-4a2d-a97d-d33be0273237]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:29:48 user nova-compute[75326]: No targets found.
Dec 06 14:29:48 user nova-compute[75326]: iSNS:
Dec 06 14:29:48 user nova-compute[75326]: No targets found.
Dec 06 14:29:48 user nova-compute[75326]: STATIC:
Dec 06 14:29:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:29:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:29:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:29:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0
Dec 06 14:29:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:29:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:29:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f
Dec 06 14:29:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:29:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:29:48 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:29:48 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:29:48 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:29:48 user nova-compute[75326]: FIRMWARE:
Dec 06 14:29:48 user nova-compute[75326]: No targets found.
Dec 06 14:29:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:29:48 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:29:48 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fda39b-954b-4eae-9724-38ef1a7ccfc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[510aaa48-6079-46e8-ba25-8b6f3cfb5144]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)
Dec 06 14:29:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:29:48 user nova-compute[75326]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f (non-flash)
Dec 06 14:29:48 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd43d2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f'): ({'sde'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Removing single pathed devices sde {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[26354b7c-2721-45c3-9ecd-b74bc55705bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fc4ea3-ed01-474a-9d4b-5bfa409922b4]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Flushing IO for device /dev/sde {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eba8a0-2729-4b9a-a626-4cc2c893f7a3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:29:48 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39b12b-5c44-4797-9a0a-5d19f42c1b6c]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] SCSI volumes sde have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc8cccf-65b2-4a31-bc43-6e0e16dd508f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc84b73-0fd8-408b-bcd4-cb51de4d119f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260]
Dec 06 14:29:49 user nova-compute[75326]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f, portal: 172.16.0.220,3260] successful.
Dec 06 14:29:49 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb25b16-675b-4e63-ac20-31a7c16ad77f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67113c-40c3-4d4e-a6e1-d1d74bdbc859]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:29:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:29:50 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lazy-loading 'flavor' on Instance uuid 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:29:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6d5e6b4a-714f-4266-b4a4-21954122a6d5 tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:29:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:29:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:29:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:01 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 is timed out.
Dec 06 14:30:01 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully detached device vdb from instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921 from the live domain config.
Dec 06 14:30:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMkyFwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:30:01 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74820a6c-a9de-4864-adc4-44550ae4d27a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:30:01 user nova-compute[75326]: No targets found.
Dec 06 14:30:01 user nova-compute[75326]: iSNS:
Dec 06 14:30:01 user nova-compute[75326]: No targets found.
Dec 06 14:30:01 user nova-compute[75326]: STATIC:
Dec 06 14:30:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:30:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0
Dec 06 14:30:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428
Dec 06 14:30:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:01 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:30:01 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:01 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:01 user nova-compute[75326]: FIRMWARE:
Dec 06 14:30:01 user nova-compute[75326]: No targets found.
Dec 06 14:30:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:30:01 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:30:01 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec937e-41ac-4f2a-a113-80fa2e410df9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fca2206-da18-4a3f-86d6-2de67993b702]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:01 user nova-compute[75326]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)
Dec 06 14:30:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bcc128b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9baf482-6831-4665-83bb-b4453499d067]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f09e7a-cbd9-4405-bf47-f7916a37ae98]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9840bcfa-f75e-4474-a366-9f7dbcba62d7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79bc42-309c-4774-950e-45f55f496a38]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45abb9f-29e5-47ba-a031-6f2e183e0a9f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76d34e3-6bd6-4046-8816-4b9d992cfbd2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:01 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260]
Dec 06 14:30:01 user nova-compute[75326]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0, portal: 172.16.0.220,3260] successful.
Dec 06 14:30:01 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d32c82-c441-4f0b-ab12-13612f23c756]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== disconnect_volume: return (326ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'flavor' on Instance uuid 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ddf21681-2d2a-443b-b1be-d0861b14334d tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.783s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.669s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:02 user nova-compute[75326]: INFO nova.compute.manager [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Terminating instance
Dec 06 14:30:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-unplugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] No waiting events found dispatching network-vif-unplugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-0d5e3c64-c48e-4175-b4b0-b39fa7f80135 req-68952efb-168a-4701-a85b-a5824ef483bc service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-unplugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:30:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Instance destroyed successfully.
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lazy-loading 'resources' on Instance uuid 49dcd579-59ad-4cf9-a2bf-6114e66a5921 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1294179195',display_name='tempest-VolumesSnapshotTestJSON-instance-1294179195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1294179195',id=37,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl4xXawBH++rL0NrfxUf4TYxHyfGfaU95sWXdAekC+XhlRCUfpdvH546fLypxyLer9Ja/8EAMvOyS7qEoqdjhhAdg5YmctLO2gfyxlgbmKfkykJwN+vIJyQKccpbFBkEw==',key_name='tempest-keypair-250263465',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='618552d8f75d49e39a2ebdf7c8724e88',ramdisk_id='',reservation_id='r-vmz0ki3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-59172741',owner_user_name='tempest-VolumesSnapshotTestJSON-59172741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f383064f7aad4c1e920149c5ec072c0f',uuid=49dcd579-59ad-4cf9-a2bf-6114e66a5921,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converting VIF {"id": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "address": "fa:16:3e:0a:9c:b6", "network": {"id": "ba1e3c69-2402-4f65-8ff9-17edcc4cb195", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1925218987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "618552d8f75d49e39a2ebdf7c8724e88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef135bd-9d", "ovs_interfaceid": "0ef135bd-9db1-4c64-968f-810cebf05dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_vif [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef135bd-9d, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19d50e22-3d2f-4809-85a3-5d6da9daf1b5) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:03 user nova-compute[75326]: INFO os_vif [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=0ef135bd-9db1-4c64-968f-810cebf05dc6,network=Network(ba1e3c69-2402-4f65-8ff9-17edcc4cb195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef135bd-9d')
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMkyFwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:30:03 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b0dee-2d11-483e-8008-8ab66ae74dc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:30:03 user nova-compute[75326]: No targets found.
Dec 06 14:30:03 user nova-compute[75326]: iSNS:
Dec 06 14:30:03 user nova-compute[75326]: No targets found.
Dec 06 14:30:03 user nova-compute[75326]: STATIC:
Dec 06 14:30:03 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:30:03 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:03 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:03 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428
Dec 06 14:30:03 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:03 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:03 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:30:03 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:03 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:03 user nova-compute[75326]: FIRMWARE:
Dec 06 14:30:03 user nova-compute[75326]: No targets found.
Dec 06 14:30:03 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:30:03 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:30:03 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb636c25-3f7c-49bf-b9f5-232d35b64fd0', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f0f85-beb9-4bff-8787-3f33f5d9c0d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d32636-f51b-4dea-a462-f04f8bf72982]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:03 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:03 user nova-compute[75326]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)
Dec 06 14:30:03 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:03 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:03 user nova-compute[75326]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b326872-95d1-416f-b8a4-f832ae8cc428 (non-flash)
Dec 06 14:30:03 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40fb760>, {}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Disconnecting from: [] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] <== disconnect_volume: return (76ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:30:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Deleting instance files /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921_del
Dec 06 14:30:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Deletion of /opt/stack/data/nova/instances/49dcd579-59ad-4cf9-a2bf-6114e66a5921_del complete
Dec 06 14:30:03 user nova-compute[75326]: INFO nova.compute.manager [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 14:30:03 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:30:03 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:30:04 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:04 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Took 0.99 seconds to deallocate network for instance.
Dec 06 14:30:04 user nova-compute[75326]: WARNING nova.volume.cinder [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Attachment 39472941-bb4c-4d40-a434-d796ca0823bb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 39472941-bb4c-4d40-a434-d796ca0823bb. (HTTP 404) (Request-ID: req-6f5eb8fe-0fa6-4f10-8c06-94beeb79f25f)
Dec 06 14:30:04 user nova-compute[75326]: INFO nova.compute.manager [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Took 0.03 seconds to detach 1 volumes for instance.
Dec 06 14:30:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:05 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Deleted allocations for instance 49dcd579-59ad-4cf9-a2bf-6114e66a5921
Dec 06 14:30:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] Acquiring lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] No waiting events found dispatching network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:05 user nova-compute[75326]: WARNING nova.compute.manager [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received unexpected event network-vif-plugged-0ef135bd-9db1-4c64-968f-810cebf05dc6 for instance with vm_state deleted and task_state None.
Dec 06 14:30:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-b623ea4f-751d-43f7-bafd-f37569aeb473 req-fdb0db5e-b8f8-42dc-bbcd-9cd0e4ec2683 service nova] [instance: 49dcd579-59ad-4cf9-a2bf-6114e66a5921] Received event network-vif-deleted-0ef135bd-9db1-4c64-968f-810cebf05dc6 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0478cd10-9968-4fe0-9525-1df8d07bccbe tempest-VolumesSnapshotTestJSON-59172741 tempest-VolumesSnapshotTestJSON-59172741-project-member] Lock "49dcd579-59ad-4cf9-a2bf-6114e66a5921" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG nova.compute.manager [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing instance network info cache due to event network-changed-b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG nova.network.neutron [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Refreshing network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG nova.network.neutron [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated VIF entry in instance network info cache for port b497ae2a-97d3-43e7-8741-fa8d1659aa69. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG nova.network.neutron [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2197152d-d072-4328-8113-4cde002cbf08 req-61567e24-9f2e-40e4-8989-c1c97c70464d service nova] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-changed-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.compute.manager [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Refreshing instance network info cache due to event network-changed-37473d08-ec2d-4ca7-8e54-25552f2d5356. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.network.neutron [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Refreshing network info cache for port 37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Stashing vm_state: active {{(pid=75326) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:30:17 user nova-compute[75326]: INFO nova.compute.claims [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Claim successful on node user
Dec 06 14:30:17 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating resource usage from migration 6805c25a-f8df-4e8b-ba83-c8631d64420b
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.network.neutron [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updated VIF entry in instance network info cache for port 37473d08-ec2d-4ca7-8e54-25552f2d5356. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.network.neutron [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-bb8e3c87-1641-4653-b07a-21b0b9dc1df8 req-3e5d0753-cfb3-4672-a233-0f4ae4a346ed service nova] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:30:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.311s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:18 user nova-compute[75326]: INFO nova.compute.manager [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Migrating
Dec 06 14:30:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Starting migrate_disk_and_power_off {{(pid=75326) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance destroyed successfully.
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37473d08-ec, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=321ba217-3f00-4dc9-9ace-b3d669018a73) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:19 user nova-compute[75326]: INFO os_vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec')
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:30:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:19 user nova-compute[75326]: WARNING nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrating.
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:19 user nova-compute[75326]: WARNING nova.compute.manager [req-4764b0b9-7c2c-47e4-ab6a-c1575287a9d5 req-69d20335-869a-49f3-a65a-db8969be1dfa service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrating.
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824dc10-d47f-42bb-85da-ee928ad41b49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:30:19 user nova-compute[75326]: No targets found.
Dec 06 14:30:19 user nova-compute[75326]: iSNS:
Dec 06 14:30:19 user nova-compute[75326]: No targets found.
Dec 06 14:30:19 user nova-compute[75326]: STATIC:
Dec 06 14:30:19 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:30:19 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:19 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:19 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:30:19 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:30:19 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:30:19 user nova-compute[75326]: FIRMWARE:
Dec 06 14:30:19 user nova-compute[75326]: No targets found.
Dec 06 14:30:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:30:19 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:30:19 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec8f5b-e8f8-41e8-9c68-59fc9b41185e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7ea0a-13a6-4c5b-a1a1-93912532ab13]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:19 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:19 user nova-compute[75326]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb43117e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096db3b-025d-448c-8df4-49682b5f61f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1f897-338c-4dbe-be05-f0421d8e5367]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de38056-5ce0-46f7-92de-815f71caa267]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e9106e-56a2-45a7-9437-c819cfc54f50]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO978baf30-fa358bec2acfeca8',) {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:30:19 user nova-compute[75326]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO978baf30-fa358bec2acfeca8
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2fe18-f999-49f3-a892-4510c569ea06]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e827da06-6a99-4a6b-a5db-bead61e21456]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c601f452-8775-4a80-a692-fd76fb843575]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]
Dec 06 14:30:19 user nova-compute[75326]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.
Dec 06 14:30:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f1d5c-68c4-4b75-b59e-50cc93c5a700]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== disconnect_volume: return (382ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Port 37473d08-ec2d-4ca7-8e54-25552f2d5356 binding to destination host user is already ACTIVE {{(pid=75326) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:21 user nova-compute[75326]: WARNING nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrated.
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:21 user nova-compute[75326]: WARNING nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrated.
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:21 user nova-compute[75326]: WARNING nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrated.
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:21 user nova-compute[75326]: WARNING nova.compute.manager [req-9c43211b-ea72-408e-9b84-a4715cc03891 req-c096a47a-a11e-4d79-bd11-64fdc0164e29 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_migrated.
Dec 06 14:30:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.utils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4fd9b8-7c53-41f0-be46-8c831b90b1e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70baebab-8c9e-4417-9198-2b04b91d75b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbe2af-b8b1-4ec5-85d7-08774d247dc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b0b96-4dae-4fcd-8031-6314fb606f5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:30:21 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:30:21 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1624ca0-168c-4fb5-9845-82ffbcad39d7]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:30:21 user nova-compute[75326]: DEBUG os_brick.utils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:24 user nova-compute[75326]: INFO nova.compute.manager [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Terminating instance
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-unplugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] No waiting events found dispatching network-vif-unplugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-82c9392a-bfce-413f-a1c3-dfd7f1e695bf req-d7ccd84d-96d5-4708-8674-f1d311bfa894 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-unplugged-1dbd6361-75b8-42c4-af85-c4758b0a553d for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:30:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Instance destroyed successfully.
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lazy-loading 'resources' on Instance uuid 5378aa00-65c1-43c2-bbd5-0daf4e0e061f {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2146114244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2146114',id=38,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXc2aoX7u1j4U9AZ5KVSxS2mkOtG0qJxIRoa9GErV4m3AHfOqh+olzd/ALoZ2uJ98Va5EYzKqDbjUyEdZDt0mdjR8WkTvFIh/Al0CMEyyyFbndAYh2VXGXgZYtP28aO8Q==',key_name='tempest-keypair-1666065403',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef397319fcd4eb1a31fec14fa55847a',ramdisk_id='',reservation_id='r-pc6zot0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:27:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='883471c60ead40db9e148780c24291e8',uuid=5378aa00-65c1-43c2-bbd5-0daf4e0e061f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converting VIF {"id": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "address": "fa:16:3e:9d:5a:7d", "network": {"id": "7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-444611206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef397319fcd4eb1a31fec14fa55847a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dbd6361-75", "ovs_interfaceid": "1dbd6361-75b8-42c4-af85-c4758b0a553d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG os_vif [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dbd6361-75, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4da95555-daba-4461-9ce7-07d2ceda60c6) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:24 user nova-compute[75326]: INFO os_vif [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=1dbd6361-75b8-42c4-af85-c4758b0a553d,network=Network(7d842a7c-eb8b-48f5-b3aa-53ce8f4bbee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dbd6361-75')
Dec 06 14:30:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Deleting instance files /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f_del
Dec 06 14:30:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Deletion of /opt/stack/data/nova/instances/5378aa00-65c1-43c2-bbd5-0daf4e0e061f_del complete
Dec 06 14:30:25 user nova-compute[75326]: INFO nova.compute.manager [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 06 14:30:25 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:25 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Took 0.70 seconds to deallocate network for instance.
Dec 06 14:30:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-52361cde-a679-4ee6-978e-051357e3f85f req-3e45f11a-d293-459c-963c-2a71b5f44755 service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-deleted-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:25 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:26 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Deleted allocations for instance 5378aa00-65c1-43c2-bbd5-0daf4e0e061f
Dec 06 14:30:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2ceeb13c-c218-499b-b7ee-c04dbdfb909d tempest-TestServerVolumeAttachScenarioOldVersion-473627157 tempest-TestServerVolumeAttachScenarioOldVersion-473627157-project-member] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] Acquiring lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] Lock "5378aa00-65c1-43c2-bbd5-0daf4e0e061f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:26 user nova-compute[75326]: DEBUG nova.compute.manager [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] No waiting events found dispatching network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:26 user nova-compute[75326]: WARNING nova.compute.manager [req-693ca1ea-de54-49cc-9cd2-83457bbcce96 req-362c2327-c992-4532-8ea5-91350925bfad service nova] [instance: 5378aa00-65c1-43c2-bbd5-0daf4e0e061f] Received unexpected event network-vif-plugged-1dbd6361-75b8-42c4-af85-c4758b0a553d for instance with vm_state deleted and task_state None.
Dec 06 14:30:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Starting finish_migration {{(pid=75326) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:30:31 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Creating image(s)
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start _get_guest_xml network_info=[{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '1004a5a7-9b37-4754-bbbe-081d5aaefc88', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f3926e02-a7c3-4831-a548-8e1ec2cb5e3d', 'attached_at': '2023-12-06T14:30:32.000000', 'detached_at': '', 'volume_id': '46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'serial': '46cd1d9e-26d5-4aaf-860c-8f80190687c7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:30:31 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:30:31 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:30:31 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:30:32 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:30:32 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:30:32 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90d106-e2f8-4004-a202-6b2f6b73f2bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:30:32 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaefa71b-63b5-4fa6-96da-6ceeb24792eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7] added
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb1c52-e35d-4dcc-99de-e8149582103a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c81ace-dce2-4e63-8422-41e4b8b79d12]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woKbZRDm {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woKbZRDm" returned: 0 in 0.079s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fbdadf-6b13-4c68-b1b2-1395e6f1e9a9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woKbZRDm'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a3e3c3-40ef-4bf9-8fcd-48744152a413]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c387c-f14d-4985-83f5-083b079013c6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72549b7f-c3c4-4d76-baf7-16354be96556]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]
Dec 06 14:30:32 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0b81f-4be9-4a65-b6eb-5f11cad6fb23]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[80600279-787b-4a61-a949-e9316646d3d6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:32 user nova-compute[75326]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:30:32 user nova-compute[75326]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:30:32 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8499e42e-f881-4298-acf3-2b607c6ab257]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:30:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26661333538626563', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333538626563', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:30:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:30:33 user nova-compute[75326]:   <uuid>f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</uuid>
Dec 06 14:30:33 user nova-compute[75326]:   <name>instance-00000027</name>
Dec 06 14:30:33 user nova-compute[75326]:   <memory>2097152</memory>
Dec 06 14:30:33 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:30:33 user nova-compute[75326]:   <metadata>
Dec 06 14:30:33 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:30:33 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:30:33 user nova-compute[75326]:       <nova:name>tempest-ServerActionsTestOtherA-server-586265264</nova:name>
Dec 06 14:30:33 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:30:31</nova:creationTime>
Dec 06 14:30:33 user nova-compute[75326]:       <nova:flavor name="m1.small">
Dec 06 14:30:33 user nova-compute[75326]:         <nova:memory>2048</nova:memory>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:disk>20</nova:disk>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:30:33 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:30:33 user nova-compute[75326]:       <nova:owner>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:user uuid="584d6786de6449e7b07e35ca2a0a2291">tempest-ServerActionsTestOtherA-1568176033-project-member</nova:user>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:project uuid="fcea056f8f4348118fce811a5b38bbe3">tempest-ServerActionsTestOtherA-1568176033</nova:project>
Dec 06 14:30:33 user nova-compute[75326]:       </nova:owner>
Dec 06 14:30:33 user nova-compute[75326]:       <nova:ports>
Dec 06 14:30:33 user nova-compute[75326]:         <nova:port uuid="37473d08-ec2d-4ca7-8e54-25552f2d5356">
Dec 06 14:30:33 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 14:30:33 user nova-compute[75326]:         </nova:port>
Dec 06 14:30:33 user nova-compute[75326]:       </nova:ports>
Dec 06 14:30:33 user nova-compute[75326]:     </nova:instance>
Dec 06 14:30:33 user nova-compute[75326]:   </metadata>
Dec 06 14:30:33 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:30:33 user nova-compute[75326]:     <system>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="serial">f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</entry>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="uuid">f3926e02-a7c3-4831-a548-8e1ec2cb5e3d</entry>
Dec 06 14:30:33 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:30:33 user nova-compute[75326]:     </system>
Dec 06 14:30:33 user nova-compute[75326]:   </sysinfo>
Dec 06 14:30:33 user nova-compute[75326]:   <os>
Dec 06 14:30:33 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:30:33 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:30:33 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:30:33 user nova-compute[75326]:   </os>
Dec 06 14:30:33 user nova-compute[75326]:   <features>
Dec 06 14:30:33 user nova-compute[75326]:     <acpi/>
Dec 06 14:30:33 user nova-compute[75326]:     <apic/>
Dec 06 14:30:33 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:30:33 user nova-compute[75326]:   </features>
Dec 06 14:30:33 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:30:33 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:30:33 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:30:33 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:30:33 user nova-compute[75326]:   </clock>
Dec 06 14:30:33 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:30:33 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:30:33 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:30:33 user nova-compute[75326]:   </cpu>
Dec 06 14:30:33 user nova-compute[75326]:   <devices>
Dec 06 14:30:33 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:30:33 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:30:33 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:30:33 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:30:33 user nova-compute[75326]:       <serial>46cd1d9e-26d5-4aaf-860c-8f80190687c7</serial>
Dec 06 14:30:33 user nova-compute[75326]:     </disk>
Dec 06 14:30:33 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:30:33 user nova-compute[75326]:       <mac address="fa:16:3e:ff:b4:2b"/>
Dec 06 14:30:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:30:33 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:30:33 user nova-compute[75326]:       <target dev="tap37473d08-ec"/>
Dec 06 14:30:33 user nova-compute[75326]:     </interface>
Dec 06 14:30:33 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:30:33 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d/console.log" append="off"/>
Dec 06 14:30:33 user nova-compute[75326]:     </serial>
Dec 06 14:30:33 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:30:33 user nova-compute[75326]:     <video>
Dec 06 14:30:33 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:30:33 user nova-compute[75326]:     </video>
Dec 06 14:30:33 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:30:33 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:30:33 user nova-compute[75326]:     </rng>
Dec 06 14:30:33 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:30:33 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:30:33 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:30:33 user nova-compute[75326]:     </memballoon>
Dec 06 14:30:33 user nova-compute[75326]:   </devices>
Dec 06 14:30:33 user nova-compute[75326]: </domain>
Dec 06 14:30:33 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:30:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-487296808-network", "vif_mac": "fa:16:3e:ff:b4:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG os_vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a65d252-0c5d-514a-b75d-f87a945ee61c', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37473d08-ec, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37473d08-ec, col_values=(('qos', UUID('d81a00ce-9b4a-4672-bae2-3b90bdf0bf08')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37473d08-ec, col_values=(('external_ids', {'iface-id': '37473d08-ec2d-4ca7-8e54-25552f2d5356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b4:2b', 'vm-uuid': 'f3926e02-a7c3-4831-a548-8e1ec2cb5e3d'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:33 user nova-compute[75326]: INFO os_vif [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec')
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:30:33 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] No VIF found with MAC fa:16:3e:ff:b4:2b, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:35 user nova-compute[75326]: WARNING nova.compute.manager [req-e8fbfb71-0bcf-4e91-9aa7-6065a54d6cf0 req-2c1e8451-f6e1-475f-881c-27823ae984b5 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_finish.
Dec 06 14:30:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:30:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance running successfully.
Dec 06 14:30:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Failed to set time: agent not configured {{(pid=75326) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ea6a7ab8-3f0b-47c3-b7ec-813aa1566671 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] finish_migration finished successfully. {{(pid=75326) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:37 user nova-compute[75326]: WARNING nova.compute.manager [req-ad115c94-59e5-45c1-b1de-394d80bb3170 req-d63da287-6fb7-4257-b25c-8fc8800e44dd service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state resize_finish.
Dec 06 14:30:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:40 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:30:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:30:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:30:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.341796875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Applying migration context for instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d as it has an incoming, in-progress migration 6805c25a-f8df-4e8b-ba83-c8631d64420b. Migration status is finished {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 14:30:45 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating resource usage from migration 6805c25a-f8df-4e8b-ba83-c8631d64420b
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ef56e0e8-3dbe-4df9-8c54-b431111dcd01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Migration 6805c25a-f8df-4e8b-ba83-c8631d64420b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:30:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:30:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:49 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:30:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:30:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing instance network info cache due to event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:30:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:30:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:30:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:30:58 user nova-compute[75326]: DEBUG nova.network.neutron [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updated VIF entry in instance network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:30:58 user nova-compute[75326]: DEBUG nova.network.neutron [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:30:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f70ff301-ad87-4962-aab5-9a340671e068 req-db6bf3d0-6c48-48cb-9d51-f7edd33aac08 service nova] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:30:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:59 user nova-compute[75326]: INFO nova.compute.manager [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Shelve offloading
Dec 06 14:30:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:30:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:30:59 user nova-compute[75326]: WARNING nova.compute.manager [req-ce7fc8e6-b0b6-403a-8424-de180db3b922 req-004d8b3d-74c2-4449-87a0-b5983cb9e9ec service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state active and task_state shelving.
Dec 06 14:31:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance destroyed successfully.
Dec 06 14:31:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:31:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:31:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:31:00 user nova-compute[75326]: DEBUG nova.network.neutron [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:31:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:31:01 user nova-compute[75326]: WARNING nova.compute.manager [req-3d0d3277-82c1-4401-8323-f64281388cba req-dce9a752-3e00-46aa-924e-57f652df0165 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state active and task_state shelving.
Dec 06 14:31:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance destroyed successfully.
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'resources' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMXWpQJz31SCBsHnmFwAo2hyPmOqIik03FnFgc6Cm6LuIp8zHAoVkA7V1tUH644LBBghnT8UD14KPC+wo5x1sO8rcQ7Kmy8qL2VvFr8/xcO2r9H640dZzFMiM8xrP7OUA==',key_name='tempest-TestShelveInstance-760153415',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:29:21Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_vif [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap410384c4-8b, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7b25299-0614-4db6-9dd4-7ddbd0d0b924) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:31:02 user nova-compute[75326]: INFO os_vif [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b')
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:31:02 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f3705-c45d-45a2-8448-745907f2d44a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:31:02 user nova-compute[75326]: No targets found.
Dec 06 14:31:02 user nova-compute[75326]: iSNS:
Dec 06 14:31:02 user nova-compute[75326]: No targets found.
Dec 06 14:31:02 user nova-compute[75326]: STATIC:
Dec 06 14:31:02 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:31:02 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:31:02 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:31:02 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:31:02 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:31:02 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:31:02 user nova-compute[75326]: FIRMWARE:
Dec 06 14:31:02 user nova-compute[75326]: No targets found.
Dec 06 14:31:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:31:02 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:31:02 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac0b78-9bb0-4362-8dee-3c0b9a60c39a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d55910-de58-4588-b40c-471b287df691]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:31:02 user nova-compute[75326]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:31:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:31:02 user nova-compute[75326]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:31:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40f9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f45e9-2cc6-4f9b-af0f-7e1bb002eb70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2f5233-d38b-4397-ac81-c40ac8a2240d]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc93b0-843f-4433-92f0-68490c729633]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ccbd3-ab11-4a3c-9a9b-74ecc32e49e7]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e1149-15af-43db-a7c8-e8f850144443]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb936c78-47ab-4657-99a0-6d72c1e6a86d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]
Dec 06 14:31:02 user nova-compute[75326]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.
Dec 06 14:31:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d04ee-1bfa-4e06-9b8b-8f1cc38823cd]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== disconnect_volume: return (312ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:31:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:31:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deleting instance files /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01_del
Dec 06 14:31:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deletion of /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01_del complete
Dec 06 14:31:03 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Deleted allocations for instance ef56e0e8-3dbe-4df9-8c54-b431111dcd01
Dec 06 14:31:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'numa_topology' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG nova.objects.base [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Object Instance<ef56e0e8-3dbe-4df9-8c54-b431111dcd01> lazy-loaded attributes: resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:31:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-218d211a-6af8-4a75-a7b5-9e953d574c57 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.385s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:31:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:31:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:46 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:31:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:31:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:31:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:47 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:31:47 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.33649444580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Applying migration context for instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d as it has an incoming, in-progress migration 6805c25a-f8df-4e8b-ba83-c8631d64420b. Migration status is finished {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 14:31:48 user nova-compute[75326]: INFO nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating resource usage from migration 6805c25a-f8df-4e8b-ba83-c8631d64420b
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Migration 6805c25a-f8df-4e8b-ba83-c8631d64420b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:31:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.956s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:31:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:49 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:31:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 06 14:31:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:31:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:31:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:31:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:32:02 user nova-compute[75326]: INFO nova.compute.claims [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Claim successful on node user
Dec 06 14:32:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:32:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:32:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:32:02 user nova-compute[75326]: INFO nova.virt.block_device [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Booting with volume snapshot 4e40dd62-d1c1-4b9d-87ee-2341de391c84 at /dev/vda
Dec 06 14:32:03 user nova-compute[75326]: DEBUG nova.policy [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:32:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Successfully created port: 808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:32:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Successfully updated port: 808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:32:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:32:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:32:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-changed-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Refreshing instance network info cache due to event network-changed-808acde8-ae2c-47df-b918-a3afa9744e17. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] Acquiring lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updating instance_info_cache with network_info: [{"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Instance network_info: |[{"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] Acquired lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Refreshing network info cache for port 808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updated VIF entry in instance network info cache for port 808acde8-ae2c-47df-b918-a3afa9744e17. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updating instance_info_cache with network_info: [{"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:32:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-22ac346f-ed9d-49b5-b09e-7069244213eb req-01a652ef-c40d-4168-9901-99d8a798eb4e service nova] Releasing lock "refresh_cache-c711503a-a9c3-481f-8960-ccbebad27b90" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Going to confirm migration 2 {{(pid=75326) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG nova.network.neutron [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:32:06 user nova-compute[75326]: DEBUG nova.objects.instance [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'info_cache' on Instance uuid f3926e02-a7c3-4831-a548-8e1ec2cb5e3d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG nova.network.neutron [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG nova.objects.instance [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'migration_context' on Instance uuid f3926e02-a7c3-4831-a548-8e1ec2cb5e3d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG nova.objects.base [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Object Instance<f3926e02-a7c3-4831-a548-8e1ec2cb5e3d> lazy-loaded attributes: info_cache,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:32:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.231s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:07 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Deleted allocation for migration 6805c25a-f8df-4e8b-ba83-c8631d64420b
Dec 06 14:32:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-bd689592-50db-4527-af16-d1b730c5bdbf tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.128s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.utils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ce0e1-492a-4f5d-8ce6-e14dfd221846]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a947c-c8ec-47a4-8fe4-116521522ba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b2839-7ba9-4837-ae0c-e3ae85f46af3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b4b79-cea4-4cff-9a72-5c1c1850ef38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:32:08 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:32:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e3eef-6c17-431e-8717-773985fa46e1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG os_brick.utils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:32:08 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updating existing volume attachment record: 58860548-0acd-4428-89fa-c881834f30ae {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:32:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:32:18 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Creating image(s)
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Ensure instance console log exists: /opt/stack/data/nova/instances/c711503a-a9c3-481f-8960-ccbebad27b90/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Start _get_guest_xml network_info=[{"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '58860548-0acd-4428-89fa-c881834f30ae', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmDzkbof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c711503a-a9c3-481f-8960-ccbebad27b90', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3f748d2-af44-4739-8e68-d0a3498dece2', 'serial': 'e3f748d2-af44-4739-8e68-d0a3498dece2'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:32:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:32:18 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmDzkbof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:32:18 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:32:18 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:32:18 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec000c3-293f-4246-9230-8dc24c97cc00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:32:18 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecbd06f-3c1a-401a-97b9-53dfb20a4b36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2] added
Dec 06 14:32:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[82abeaff-57e6-4d65-818d-b0d7977a7ff0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c244ffd-2f5e-42ba-ab98-e512ecf8373b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmDzkbof {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmDzkbof" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cf6cd-6bf1-405c-81be-e59f6de8c9e6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nmDzkbof'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9101c5-0702-437a-ae08-d12bf8c09cca]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f352d-5849-4f06-9dda-782ea88d4418]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:32:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:32:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56f8b3d-e063-4ffd-9e55-19abc688445c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260]
Dec 06 14:32:18 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260] successful.
Dec 06 14:32:18 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459b912-9f74-417d-b675-e03d14ca9929]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:32:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878f806-dfcf-470c-9368-79896c8c6f87]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:32:19 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:32:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:32:19 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:32:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac0408-a33c-4fb8-bdd5-4544a6a74693]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmDzkbof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:32:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23138373634623238', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138373634623238', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-503963312',display_name='tempest-TestVolumeBootPattern-server-503963312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-503963312',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-50l6ud4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:32:03Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c711503a-a9c3-481f-8960-ccbebad27b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid c711503a-a9c3-481f-8960-ccbebad27b90 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:32:20 user nova-compute[75326]:   <uuid>c711503a-a9c3-481f-8960-ccbebad27b90</uuid>
Dec 06 14:32:20 user nova-compute[75326]:   <name>instance-00000029</name>
Dec 06 14:32:20 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:32:20 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:32:20 user nova-compute[75326]:   <metadata>
Dec 06 14:32:20 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:32:20 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:32:20 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-server-503963312</nova:name>
Dec 06 14:32:20 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:32:18</nova:creationTime>
Dec 06 14:32:20 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:32:20 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:32:20 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:32:20 user nova-compute[75326]:       <nova:owner>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:32:20 user nova-compute[75326]:       </nova:owner>
Dec 06 14:32:20 user nova-compute[75326]:       <nova:ports>
Dec 06 14:32:20 user nova-compute[75326]:         <nova:port uuid="808acde8-ae2c-47df-b918-a3afa9744e17">
Dec 06 14:32:20 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 14:32:20 user nova-compute[75326]:         </nova:port>
Dec 06 14:32:20 user nova-compute[75326]:       </nova:ports>
Dec 06 14:32:20 user nova-compute[75326]:     </nova:instance>
Dec 06 14:32:20 user nova-compute[75326]:   </metadata>
Dec 06 14:32:20 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:32:20 user nova-compute[75326]:     <system>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="serial">c711503a-a9c3-481f-8960-ccbebad27b90</entry>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="uuid">c711503a-a9c3-481f-8960-ccbebad27b90</entry>
Dec 06 14:32:20 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:32:20 user nova-compute[75326]:     </system>
Dec 06 14:32:20 user nova-compute[75326]:   </sysinfo>
Dec 06 14:32:20 user nova-compute[75326]:   <os>
Dec 06 14:32:20 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:32:20 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:32:20 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:32:20 user nova-compute[75326]:   </os>
Dec 06 14:32:20 user nova-compute[75326]:   <features>
Dec 06 14:32:20 user nova-compute[75326]:     <acpi/>
Dec 06 14:32:20 user nova-compute[75326]:     <apic/>
Dec 06 14:32:20 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:32:20 user nova-compute[75326]:   </features>
Dec 06 14:32:20 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:32:20 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:32:20 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:32:20 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:32:20 user nova-compute[75326]:   </clock>
Dec 06 14:32:20 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:32:20 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:32:20 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:32:20 user nova-compute[75326]:   </cpu>
Dec 06 14:32:20 user nova-compute[75326]:   <devices>
Dec 06 14:32:20 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:32:20 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:32:20 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:32:20 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:32:20 user nova-compute[75326]:       <serial>e3f748d2-af44-4739-8e68-d0a3498dece2</serial>
Dec 06 14:32:20 user nova-compute[75326]:     </disk>
Dec 06 14:32:20 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:32:20 user nova-compute[75326]:       <mac address="fa:16:3e:4f:9b:9c"/>
Dec 06 14:32:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:32:20 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:32:20 user nova-compute[75326]:       <target dev="tap808acde8-ae"/>
Dec 06 14:32:20 user nova-compute[75326]:     </interface>
Dec 06 14:32:20 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:32:20 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/c711503a-a9c3-481f-8960-ccbebad27b90/console.log" append="off"/>
Dec 06 14:32:20 user nova-compute[75326]:     </serial>
Dec 06 14:32:20 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:32:20 user nova-compute[75326]:     <video>
Dec 06 14:32:20 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:32:20 user nova-compute[75326]:     </video>
Dec 06 14:32:20 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:32:20 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:32:20 user nova-compute[75326]:     </rng>
Dec 06 14:32:20 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:32:20 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:32:20 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:32:20 user nova-compute[75326]:     </memballoon>
Dec 06 14:32:20 user nova-compute[75326]:   </devices>
Dec 06 14:32:20 user nova-compute[75326]: </domain>
Dec 06 14:32:20 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-503963312',display_name='tempest-TestVolumeBootPattern-server-503963312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-503963312',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-50l6ud4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:32:03Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c711503a-a9c3-481f-8960-ccbebad27b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG os_vif [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '535dd34c-9cc1-5972-a50f-da946860120d', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap808acde8-ae, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap808acde8-ae, col_values=(('qos', UUID('9afdf744-e09a-4081-88e0-c885580168f4')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap808acde8-ae, col_values=(('external_ids', {'iface-id': '808acde8-ae2c-47df-b918-a3afa9744e17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:9b:9c', 'vm-uuid': 'c711503a-a9c3-481f-8960-ccbebad27b90'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:20 user nova-compute[75326]: INFO os_vif [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae')
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:32:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:4f:9b:9c, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:21 user nova-compute[75326]: DEBUG nova.compute.manager [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:32:21 user nova-compute[75326]: WARNING nova.compute.manager [req-7abc262a-de8d-42f0-988a-c1dc4a5adaac req-74c637b3-e766-4a4c-8ece-20f55145b9dc service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state building and task_state spawning.
Dec 06 14:32:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:32:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Instance spawned successfully.
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:32:23 user nova-compute[75326]: INFO nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Took 5.13 seconds to spawn the instance on the hypervisor.
Dec 06 14:32:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:32:23 user nova-compute[75326]: INFO nova.compute.manager [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Took 21.55 seconds to build instance.
Dec 06 14:32:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e2116781-690c-4d62-b80c-65cf2eccf31f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.658s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:32:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:32:24 user nova-compute[75326]: WARNING nova.compute.manager [req-c1ff2f29-2012-4fcb-9ab9-1765a8d99ee4 req-7626c311-4d22-49f7-bfbc-796e489bb4ee service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state active and task_state None.
Dec 06 14:32:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:38 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:32:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:32:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:32:48 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:32:48 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.317283630371094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c711503a-a9c3-481f-8960-ccbebad27b90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:32:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:32:50 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:51 user nova-compute[75326]: INFO nova.compute.manager [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Unshelving
Dec 06 14:32:51 user nova-compute[75326]: INFO nova.virt.block_device [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Booting with volume 4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd at /dev/vda
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.utils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65321d83-a18f-4ba8-8d26-f95522112fc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5f92b-5cae-4819-81a1-ede85fff5ad4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cf94b5-d3cb-43b5-9cc6-7a50d6f02a75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[395830c6-7d19-467b-ba68-45cc13d6267f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:32:51 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[616a946c-c4e5-4c9a-9f7f-a9191fa5e03c]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG os_brick.utils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating existing volume attachment record: 9de5a715-c0f3-4cbd-9034-970d325816b3 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:32:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:32:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:32:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid f3926e02-a7c3-4831-a548-8e1ec2cb5e3d {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid c711503a-a9c3-481f-8960-ccbebad27b90 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:32:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:32:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:32:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'pci_requests' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'numa_topology' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:33:01 user nova-compute[75326]: INFO nova.compute.claims [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Claim successful on node user
Dec 06 14:33:01 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:33:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:01 user nova-compute[75326]: INFO nova.network.neutron [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating port 410384c4-8b2c-4aba-add4-e7be99c32197 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.compute.manager [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing instance network info cache due to event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:33:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Creating image(s)
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Ensure instance console log exists: /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start _get_guest_xml network_info=[{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '9de5a715-c0f3-4cbd-9034-970d325816b3', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef56e0e8-3dbe-4df9-8c54-b431111dcd01', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'serial': '4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.network.neutron [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:33:02 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:33:02 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.objects.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Object Instance<ef56e0e8-3dbe-4df9-8c54-b431111dcd01> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:33:02 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:33:02 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:33:02 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[360348d7-7ff1-4ad4-9856-c7b62ccb7b86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:33:02 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2474dc2e-f3db-4c64-ab06-e5f47d606ed2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd] added
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747e1a8-fd82-4654-80ae-e2e6178fe576]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5850a-b356-44c7-9c5c-e776b45bcb9e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v begqnOAp {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v begqnOAp" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdc9c8b-bbd0-4f16-9413-3cefe6fdc6ba]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'begqnOAp'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2addfc2-2cce-44b7-b20f-f6b0d3c89eec]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[025865bb-0bbd-444c-aed8-24780762bcee]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3c2f3-3a9e-4cd0-bc73-487b2740efde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]
Dec 06 14:33:02 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8040df-a7c4-4824-8594-8d207225c966]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7dc70c-2ba4-4b66-943a-3ee58aa546d7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:02 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:33:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[968de82c-14df-4f48-b4d1-7da244281fa1]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:33:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updated VIF entry in instance network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a06c7faf-2e3f-4c63-a723-39bbd3175f2a req-28ff4197-ffd7-4135-8347-d369d4e3fc48 service nova] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23237646532306362', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:33:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237646532306362', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-760153415',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:32:51Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.objects.instance [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'pci_devices' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.objects.base [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Object Instance<ef56e0e8-3dbe-4df9-8c54-b431111dcd01> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:33:04 user nova-compute[75326]:   <uuid>ef56e0e8-3dbe-4df9-8c54-b431111dcd01</uuid>
Dec 06 14:33:04 user nova-compute[75326]:   <name>instance-00000028</name>
Dec 06 14:33:04 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:33:04 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:33:04 user nova-compute[75326]:   <metadata>
Dec 06 14:33:04 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:33:04 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:33:04 user nova-compute[75326]:       <nova:name>tempest-TestShelveInstance-server-608812256</nova:name>
Dec 06 14:33:04 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:33:02</nova:creationTime>
Dec 06 14:33:04 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:33:04 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:33:04 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:33:04 user nova-compute[75326]:       <nova:owner>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:user uuid="deb48db836b440bfa0c5ba816cedbe46">tempest-TestShelveInstance-476323943-project-member</nova:user>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:project uuid="b99d83ca71f343968cfce19b49178fe6">tempest-TestShelveInstance-476323943</nova:project>
Dec 06 14:33:04 user nova-compute[75326]:       </nova:owner>
Dec 06 14:33:04 user nova-compute[75326]:       <nova:ports>
Dec 06 14:33:04 user nova-compute[75326]:         <nova:port uuid="410384c4-8b2c-4aba-add4-e7be99c32197">
Dec 06 14:33:04 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:33:04 user nova-compute[75326]:         </nova:port>
Dec 06 14:33:04 user nova-compute[75326]:       </nova:ports>
Dec 06 14:33:04 user nova-compute[75326]:     </nova:instance>
Dec 06 14:33:04 user nova-compute[75326]:   </metadata>
Dec 06 14:33:04 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:33:04 user nova-compute[75326]:     <system>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="serial">ef56e0e8-3dbe-4df9-8c54-b431111dcd01</entry>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="uuid">ef56e0e8-3dbe-4df9-8c54-b431111dcd01</entry>
Dec 06 14:33:04 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:33:04 user nova-compute[75326]:     </system>
Dec 06 14:33:04 user nova-compute[75326]:   </sysinfo>
Dec 06 14:33:04 user nova-compute[75326]:   <os>
Dec 06 14:33:04 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:33:04 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:33:04 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:33:04 user nova-compute[75326]:   </os>
Dec 06 14:33:04 user nova-compute[75326]:   <features>
Dec 06 14:33:04 user nova-compute[75326]:     <acpi/>
Dec 06 14:33:04 user nova-compute[75326]:     <apic/>
Dec 06 14:33:04 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:33:04 user nova-compute[75326]:   </features>
Dec 06 14:33:04 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:33:04 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:33:04 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:33:04 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:33:04 user nova-compute[75326]:   </clock>
Dec 06 14:33:04 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:33:04 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:33:04 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:33:04 user nova-compute[75326]:   </cpu>
Dec 06 14:33:04 user nova-compute[75326]:   <devices>
Dec 06 14:33:04 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:33:04 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:33:04 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:33:04 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:33:04 user nova-compute[75326]:       <serial>4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd</serial>
Dec 06 14:33:04 user nova-compute[75326]:     </disk>
Dec 06 14:33:04 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:33:04 user nova-compute[75326]:       <mac address="fa:16:3e:0b:7b:89"/>
Dec 06 14:33:04 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:33:04 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:33:04 user nova-compute[75326]:       <target dev="tap410384c4-8b"/>
Dec 06 14:33:04 user nova-compute[75326]:     </interface>
Dec 06 14:33:04 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:33:04 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01/console.log" append="off"/>
Dec 06 14:33:04 user nova-compute[75326]:     </serial>
Dec 06 14:33:04 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:33:04 user nova-compute[75326]:     <video>
Dec 06 14:33:04 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:33:04 user nova-compute[75326]:     </video>
Dec 06 14:33:04 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:33:04 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:33:04 user nova-compute[75326]:     </rng>
Dec 06 14:33:04 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:33:04 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:33:04 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:33:04 user nova-compute[75326]:     </memballoon>
Dec 06 14:33:04 user nova-compute[75326]:   </devices>
Dec 06 14:33:04 user nova-compute[75326]: </domain>
Dec 06 14:33:04 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-760153415',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:32:51Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG os_vif [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60faec6e-c863-5202-9161-4f04d131f5d1', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap410384c4-8b, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap410384c4-8b, col_values=(('qos', UUID('16744ab7-6e01-42fd-b845-b6604458b43b')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap410384c4-8b, col_values=(('external_ids', {'iface-id': '410384c4-8b2c-4aba-add4-e7be99c32197', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:7b:89', 'vm-uuid': 'ef56e0e8-3dbe-4df9-8c54-b431111dcd01'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:04 user nova-compute[75326]: INFO os_vif [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b')
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:33:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] No VIF found with MAC fa:16:3e:0b:7b:89, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:05 user nova-compute[75326]: WARNING nova.compute.manager [req-7408fde1-ea72-4afb-be62-a7858f521dee req-18119dd7-628b-43c8-a691-9e00555375cc service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 14:33:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:33:07 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance spawned successfully.
Dec 06 14:33:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-3d87b8bb-b9a5-4e56-8cba-ea908f0e9f36 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.633s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:07 user nova-compute[75326]: WARNING nova.compute.manager [req-a096015d-5023-4c8f-bbbd-6605cdeb53a5 req-7c0e4418-2eac-4f74-8d15-3c8b203f6313 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state active and task_state None.
Dec 06 14:33:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:33:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:33:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:33:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:33:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.306976318359375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c711503a-a9c3-481f-8960-ccbebad27b90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance ef56e0e8-3dbe-4df9-8c54-b431111dcd01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:33:50 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:33:51 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:33:51 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:33:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:33:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [{"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:52 user nova-compute[75326]: INFO nova.compute.manager [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Terminating instance
Dec 06 14:33:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-af9931d3-6413-41ec-830d-10033cb340ad req-17374d51-fb1c-4efe-acd2-0fceb784d53b service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Instance destroyed successfully.
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid c711503a-a9c3-481f-8960-ccbebad27b90 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-503963312',display_name='tempest-TestVolumeBootPattern-server-503963312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-503963312',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:32:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-50l6ud4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:32:24Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c711503a-a9c3-481f-8960-ccbebad27b90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "808acde8-ae2c-47df-b918-a3afa9744e17", "address": "fa:16:3e:4f:9b:9c", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap808acde8-ae", "ovs_interfaceid": "808acde8-ae2c-47df-b918-a3afa9744e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_vif [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap808acde8-ae, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9afdf744-e09a-4081-88e0-c885580168f4) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:33:53 user nova-compute[75326]: INFO os_vif [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:9c,bridge_name='br-int',has_traffic_filtering=True,id=808acde8-ae2c-47df-b918-a3afa9744e17,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap808acde8-ae')
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmDzkbof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:33:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a559ea45-216c-4676-9aaa-ac3a42e32bee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:33:53 user nova-compute[75326]: No targets found.
Dec 06 14:33:53 user nova-compute[75326]: iSNS:
Dec 06 14:33:53 user nova-compute[75326]: No targets found.
Dec 06 14:33:53 user nova-compute[75326]: STATIC:
Dec 06 14:33:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:33:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:33:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:33:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2
Dec 06 14:33:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:33:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:33:53 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:33:53 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:33:53 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:33:53 user nova-compute[75326]: FIRMWARE:
Dec 06 14:33:53 user nova-compute[75326]: No targets found.
Dec 06 14:33:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:33:53 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:33:53 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a3b69d-a443-401e-80c4-e1326746d7c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe165632-542d-49c5-943e-83c08a6ac727]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:53 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:53 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:33:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:33:53 user nova-compute[75326]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 (non-flash)
Dec 06 14:33:53 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:33:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40fa830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb86ccfd-e638-45a7-a057-db45630b6bfd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c5f2be-74eb-4008-8e76-51ffea1a9867]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed5938-592e-4510-ab11-0558faa3b827]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe88a1-c222-42ad-9d3e-061d8eb27d63]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3016998b-18764b282cc6c453', '/dev/disk/by-id/scsi-23138373634623238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3016998b') {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c8137-c5f0-42f0-8f77-8b24246b0be1]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff8b93-d873-458c-bbe6-2b231f1ac0df]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbc87a2-ce63-44d5-9fe1-8d24980f7d29]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260]
Dec 06 14:33:53 user nova-compute[75326]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2, portal: 172.16.0.220,3260] successful.
Dec 06 14:33:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f748d2-af44-4739-8e68-d0a3498dece2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d865e876-502f-4cc5-8a14-6626fd70a11d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (331ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:33:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Deleting instance files /opt/stack/data/nova/instances/c711503a-a9c3-481f-8960-ccbebad27b90_del
Dec 06 14:33:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Deletion of /opt/stack/data/nova/instances/c711503a-a9c3-481f-8960-ccbebad27b90_del complete
Dec 06 14:33:53 user nova-compute[75326]: INFO nova.compute.manager [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 06 14:33:53 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:33:53 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:33:54 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Took 0.53 seconds to deallocate network for instance.
Dec 06 14:33:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-2999b7da-5591-45f1-8482-87a728042a77 req-53340e66-d971-465a-87c3-3dcde0c9a9c8 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-deleted-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:54 user nova-compute[75326]: INFO nova.compute.manager [req-2999b7da-5591-45f1-8482-87a728042a77 req-53340e66-d971-465a-87c3-3dcde0c9a9c8 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Neutron deleted interface 808acde8-ae2c-47df-b918-a3afa9744e17; detaching it from the instance and deleting it from the info cache
Dec 06 14:33:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-2999b7da-5591-45f1-8482-87a728042a77 req-53340e66-d971-465a-87c3-3dcde0c9a9c8 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:33:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-2999b7da-5591-45f1-8482-87a728042a77 req-53340e66-d971-465a-87c3-3dcde0c9a9c8 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Detach interface failed, port_id=808acde8-ae2c-47df-b918-a3afa9744e17, reason: Instance c711503a-a9c3-481f-8960-ccbebad27b90 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:55 user nova-compute[75326]: WARNING nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state active and task_state deleting.
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:55 user nova-compute[75326]: WARNING nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state active and task_state deleting.
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:55 user nova-compute[75326]: WARNING nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state active and task_state deleting.
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-unplugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Acquiring lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] Lock "c711503a-a9c3-481f-8960-ccbebad27b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] No waiting events found dispatching network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:33:55 user nova-compute[75326]: WARNING nova.compute.manager [req-d9953197-71d4-4d02-b03c-1f42b426a106 req-f95ab32c-eebc-44d7-9f82-7b0f8956da08 service nova] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Received unexpected event network-vif-plugged-808acde8-ae2c-47df-b918-a3afa9744e17 for instance with vm_state active and task_state deleting.
Dec 06 14:33:55 user nova-compute[75326]: INFO nova.compute.manager [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Took 0.83 seconds to detach 1 volumes for instance.
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c711503a-a9c3-481f-8960-ccbebad27b90] Deleting volume: e3f748d2-af44-4739-8e68-d0a3498dece2 {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:55 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance c711503a-a9c3-481f-8960-ccbebad27b90
Dec 06 14:33:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b1b55bda-6725-41b1-92f7-fd92f15aa0de tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c711503a-a9c3-481f-8960-ccbebad27b90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:33:58 user nova-compute[75326]: INFO nova.compute.manager [None req-9846f8d3-5495-4b1a-bf8e-3a237258b9ef tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Get console output
Dec 06 14:33:58 user nova-compute[75326]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 06 14:33:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:33:59 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:34:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:41 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing instance network info cache due to event network-changed-410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] Acquiring lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] Acquired lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Refreshing network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:42 user nova-compute[75326]: INFO nova.compute.manager [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Terminating instance
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.compute.manager [req-4dd28145-ae2c-4768-b593-a860742d0e6d req-2e2ce2ba-8121-4779-8c5a-5c1a88d27c53 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-unplugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updated VIF entry in instance network info cache for port 410384c4-8b2c-4aba-add4-e7be99c32197. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.network.neutron [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [{"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1e68233-a5ea-488a-9586-c333e60d7840 req-952a8ea7-5800-4731-9580-3ceda0d9a5a5 service nova] Releasing lock "refresh_cache-ef56e0e8-3dbe-4df9-8c54-b431111dcd01" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:34:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Instance destroyed successfully.
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.objects.instance [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lazy-loading 'resources' on Instance uuid ef56e0e8-3dbe-4df9-8c54-b431111dcd01 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T14:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-608812256',display_name='tempest-TestShelveInstance-server-608812256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-608812256',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMXWpQJz31SCBsHnmFwAo2hyPmOqIik03FnFgc6Cm6LuIp8zHAoVkA7V1tUH644LBBghnT8UD14KPC+wo5x1sO8rcQ7Kmy8qL2VvFr8/xcO2r9H640dZzFMiM8xrP7OUA==',key_name='tempest-TestShelveInstance-760153415',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b99d83ca71f343968cfce19b49178fe6',ramdisk_id='',reservation_id='r-45ozeoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-476323943',owner_user_name='tempest-TestShelveInstance-476323943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:33:08Z,user_data=None,user_id='deb48db836b440bfa0c5ba816cedbe46',uuid=ef56e0e8-3dbe-4df9-8c54-b431111dcd01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converting VIF {"id": "410384c4-8b2c-4aba-add4-e7be99c32197", "address": "fa:16:3e:0b:7b:89", "network": {"id": "f50aace6-1345-4ba9-af1f-daf3f89cb64b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1704268404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99d83ca71f343968cfce19b49178fe6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410384c4-8b", "ovs_interfaceid": "410384c4-8b2c-4aba-add4-e7be99c32197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_vif [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap410384c4-8b, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16744ab7-6e01-42fd-b845-b6604458b43b) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:42 user nova-compute[75326]: INFO os_vif [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7b:89,bridge_name='br-int',has_traffic_filtering=True,id=410384c4-8b2c-4aba-add4-e7be99c32197,network=Network(f50aace6-1345-4ba9-af1f-daf3f89cb64b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410384c4-8b')
Dec 06 14:34:42 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'begqnOAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:34:42 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776d055-5c38-49d4-abfd-d3630c4f2689]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:34:42 user nova-compute[75326]: No targets found.
Dec 06 14:34:42 user nova-compute[75326]: iSNS:
Dec 06 14:34:42 user nova-compute[75326]: No targets found.
Dec 06 14:34:42 user nova-compute[75326]: STATIC:
Dec 06 14:34:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd
Dec 06 14:34:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:34:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:34:42 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:34:42 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:34:42 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:34:42 user nova-compute[75326]: FIRMWARE:
Dec 06 14:34:42 user nova-compute[75326]: No targets found.
Dec 06 14:34:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:34:42 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:34:42 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024c56e-46e4-40d0-a3a4-15bd49157b59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[beada9e9-d164-46e8-91ea-ba5b241947a1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:34:42 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:34:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:34:42 user nova-compute[75326]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd (non-flash)
Dec 06 14:34:42 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a165a-e604-49ef-a59a-ddc632537cd0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cad5c8-dd45-48fb-9d0c-c45c5abd8a2b]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[726052f0-00a8-4dd7-a32c-691607cbdc20]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c61369d-470f-4a83-8670-48cb18fb7444]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a225e1a0',) {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80cdd80-02e6-4b93-a2d2-ba3549ba2e35]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[810dd996-1bf4-40ee-852c-fa1b22ddb788]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b80a9-da0b-4006-abe2-ee81e661f6a7]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260]
Dec 06 14:34:43 user nova-compute[75326]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd, portal: 172.16.0.220,3260] successful.
Dec 06 14:34:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976a973-e4aa-4739-8e75-c8196d4b2008]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] <== disconnect_volume: return (309ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:34:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deleting instance files /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01_del
Dec 06 14:34:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deletion of /opt/stack/data/nova/instances/ef56e0e8-3dbe-4df9-8c54-b431111dcd01_del complete
Dec 06 14:34:43 user nova-compute[75326]: INFO nova.compute.manager [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:43 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:34:43 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Took 0.47 seconds to deallocate network for instance.
Dec 06 14:34:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] Acquiring lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] No waiting events found dispatching network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:34:44 user nova-compute[75326]: WARNING nova.compute.manager [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received unexpected event network-vif-plugged-410384c4-8b2c-4aba-add4-e7be99c32197 for instance with vm_state active and task_state deleting.
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-045a66b9-2273-447e-aaf4-84a25fef923a req-22e637c0-9341-471c-976b-7f0ab7629c61 service nova] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Received event network-vif-deleted-410384c4-8b2c-4aba-add4-e7be99c32197 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:34:44 user nova-compute[75326]: INFO nova.compute.manager [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Took 0.82 seconds to detach 1 volumes for instance.
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] [instance: ef56e0e8-3dbe-4df9-8c54-b431111dcd01] Deleting volume: 4ce34abe-1130-4fe6-8fc2-3b2c5ad511dd {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:44 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Deleted allocations for instance ef56e0e8-3dbe-4df9-8c54-b431111dcd01
Dec 06 14:34:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-b54e17db-26b3-41f0-82e7-16428d164385 tempest-TestShelveInstance-476323943 tempest-TestShelveInstance-476323943-project-member] Lock "ef56e0e8-3dbe-4df9-8c54-b431111dcd01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:34:51 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:34:51 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.305641174316406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:34:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:34:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:34:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:34:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:58 user nova-compute[75326]: INFO nova.compute.manager [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Terminating instance
Dec 06 14:34:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-4d5db94d-e237-4c81-bf6f-c71aae8ca388 req-4f3d8878-8ebc-4352-bbcc-ba5bbec2be83 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-unplugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Instance destroyed successfully.
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'resources' on Instance uuid f3926e02-a7c3-4831-a548-8e1ec2cb5e3d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586265264',display_name='tempest-ServerActionsTestOtherA-server-586265264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586265264',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-gu3hzsge',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=f3926e02-a7c3-4831-a548-8e1ec2cb5e3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "address": "fa:16:3e:ff:b4:2b", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37473d08-ec", "ovs_interfaceid": "37473d08-ec2d-4ca7-8e54-25552f2d5356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_vif [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37473d08-ec, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d81a00ce-9b4a-4672-bae2-3b90bdf0bf08) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:34:59 user nova-compute[75326]: INFO os_vif [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b4:2b,bridge_name='br-int',has_traffic_filtering=True,id=37473d08-ec2d-4ca7-8e54-25552f2d5356,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37473d08-ec')
Dec 06 14:34:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woKbZRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:34:59 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9927630-ddaa-4d28-a9b6-ff6f598d61c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:34:59 user nova-compute[75326]: No targets found.
Dec 06 14:34:59 user nova-compute[75326]: iSNS:
Dec 06 14:34:59 user nova-compute[75326]: No targets found.
Dec 06 14:34:59 user nova-compute[75326]: STATIC:
Dec 06 14:34:59 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7
Dec 06 14:34:59 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:34:59 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:34:59 user nova-compute[75326]: FIRMWARE:
Dec 06 14:34:59 user nova-compute[75326]: No targets found.
Dec 06 14:34:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:34:59 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:34:59 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc20cfe-3617-47a6-82e1-c4fda682d697]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[919df92c-0252-4d07-acce-983794b246f5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:34:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 (non-flash)
Dec 06 14:34:59 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44bf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[149bf7d7-231f-4c51-a30c-ec5220989814]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f93020-f354-4ec6-a0be-c74bf6577261]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e71678-f109-4f54-9a16-f894c36b2d42]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a2159b-5932-47ec-b281-cb714651bd37]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO978baf30-fa358bec2acfeca8', '/dev/disk/by-id/scsi-26661333538626563', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_978baf30') {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f72e4c-e255-45be-9af9-1c63fba75994]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54d67f-6cb2-47d6-95e0-c1ebec1eb2a0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:34:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[005eeb42-e57a-469b-86d8-c6e0ae292a2e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260]
Dec 06 14:35:00 user nova-compute[75326]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7, portal: 172.16.0.220,3260] successful.
Dec 06 14:35:00 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cd1d9e-26d5-4aaf-860c-8f80190687c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0798f9e-598c-4088-a3ad-ea415e6e2880]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] <== disconnect_volume: return (320ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:35:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Deleting instance files /opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d_del
Dec 06 14:35:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Deletion of /opt/stack/data/nova/instances/f3926e02-a7c3-4831-a548-8e1ec2cb5e3d_del complete
Dec 06 14:35:00 user nova-compute[75326]: INFO nova.compute.manager [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Took 1.43 seconds to destroy the instance on the hypervisor.
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:35:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] Acquiring lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] No waiting events found dispatching network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:35:01 user nova-compute[75326]: WARNING nova.compute.manager [req-654262a1-5781-4bf7-86bb-f0d4e40844a9 req-1ac8fda4-e550-4af4-b0b0-3345ac9d8e5c service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received unexpected event network-vif-plugged-37473d08-ec2d-4ca7-8e54-25552f2d5356 for instance with vm_state active and task_state deleting.
Dec 06 14:35:01 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:35:01 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Took 1.06 seconds to deallocate network for instance.
Dec 06 14:35:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:02 user nova-compute[75326]: INFO nova.compute.manager [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Took 0.89 seconds to detach 1 volumes for instance.
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Deleting volume: 46cd1d9e-26d5-4aaf-860c-8f80190687c7 {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:02 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Deleted allocations for instance f3926e02-a7c3-4831-a548-8e1ec2cb5e3d
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e2a77da-e4f8-482c-9aad-9d4463baad68 tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "f3926e02-a7c3-4831-a548-8e1ec2cb5e3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.765s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:35:02 user nova-compute[75326]: INFO nova.compute.claims [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Claim successful on node user
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:35:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:35:03 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.policy [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:35:03 user nova-compute[75326]: INFO nova.virt.block_device [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Booting with volume 5f8c694f-8217-49b5-a47c-b2d51717c953 at /dev/vda
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-f5a4f808-2f55-4b46-b063-d2f693bcd587 req-b8ba0646-c609-4ada-8e7a-ce3f6524dd28 service nova] [instance: f3926e02-a7c3-4831-a548-8e1ec2cb5e3d] Received event network-vif-deleted-37473d08-ec2d-4ca7-8e54-25552f2d5356 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.utils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e80eee1-c216-4a41-bcb0-5db1dce9fec4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af3cd7-6f2b-4f41-887e-047ff9eed3c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7fa4c0-f076-4112-9401-8b66a6aa7e9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f33c93-0e29-4980-8e61-ba2270a67b1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:35:03 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:35:03 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d68c700-0be6-4207-b880-b6b86833a118]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG os_brick.utils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating existing volume attachment record: 7df17e78-7caa-4ff4-9c02-91d322f0e3d7 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:35:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Successfully created port: f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Successfully updated port: f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:35:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Instance network_info: |[{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-changed-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Refreshing instance network info cache due to event network-changed-f3bf1710-b17b-405c-bc0e-c2b46e649e48. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] Acquiring lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] Acquired lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Refreshing network info cache for port f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updated VIF entry in instance network info cache for port f3bf1710-b17b-405c-bc0e-c2b46e649e48. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:35:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-2bb45d90-c1c6-4f83-9d5b-6a0855dfc0c4 req-53b31640-5a04-4d81-9d14-5eba79322f26 service nova] Releasing lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:35:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:35:13 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Creating image(s)
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Ensure instance console log exists: /opt/stack/data/nova/instances/c4a8370f-5716-4337-9f35-a9baf35253ff/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Start _get_guest_xml network_info=[{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '7df17e78-7caa-4ff4-9c02-91d322f0e3d7', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDOoRrtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4a8370f-5716-4337-9f35-a9baf35253ff', 'attached_at': '', 'detached_at': '', 'volume_id': '5f8c694f-8217-49b5-a47c-b2d51717c953', 'serial': '5f8c694f-8217-49b5-a47c-b2d51717c953'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:35:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:35:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDOoRrtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:35:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:35:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:35:13 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac9820-606a-415d-b71a-426f7007b335]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:35:13 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0124d15-6c6f-413e-94da-382d3819c388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953] added
Dec 06 14:35:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8990f16-cdd9-49bc-a0a8-c6bd3d5edaaf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921b6ba-f335-4398-8daf-c8eb76d0c86f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDOoRrtd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDOoRrtd" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435aae0-ce71-47c6-8990-c19cffb04385]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDOoRrtd'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f154424d-a806-49bf-b384-43f41e34af98]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03cfadf-9d7d-4b3b-a2ff-161b31a0a364]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:35:13 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 14:35:13 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:35:13 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 14:35:13 user nova-compute[75326]: 
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9c0e0-fa4b-4782-b36a-8a64d65a6a1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260]
Dec 06 14:35:13 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260] successful.
Dec 06 14:35:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.238s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f7bb45-ebc9-4d3f-a27a-88d515793811]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[587fcfa6-3eaf-4083-935d-4a58cd85c8d0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:35:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:35:13 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6943bbb-d1ca-470a-942d-085175d3d887]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:35:13 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDOoRrtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '26639333665336566', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639333665336566', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-640653941',display_name='tempest-TestVolumeBootPattern-volume-backed-server-640653941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-640653941',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq6RdV7TRjq/zj70J30+RS7t5WsZDK4ApqS3wieWeBpcTWj7bOAAyjW4gCMVTSJMIQAauZ/LjIMRBbN5zsyI2A/4VqimEmKo1sT7HsPhcnUmC6GgfL/PC2sETylcTRRrQ==',key_name='tempest-keypair-729804187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-462xm067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:35:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c4a8370f-5716-4337-9f35-a9baf35253ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid c4a8370f-5716-4337-9f35-a9baf35253ff {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:35:14 user nova-compute[75326]:   <uuid>c4a8370f-5716-4337-9f35-a9baf35253ff</uuid>
Dec 06 14:35:14 user nova-compute[75326]:   <name>instance-0000002a</name>
Dec 06 14:35:14 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:35:14 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:35:14 user nova-compute[75326]:   <metadata>
Dec 06 14:35:14 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:35:14 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:35:14 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-640653941</nova:name>
Dec 06 14:35:14 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:35:13</nova:creationTime>
Dec 06 14:35:14 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:35:14 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:35:14 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:35:14 user nova-compute[75326]:       <nova:owner>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:35:14 user nova-compute[75326]:       </nova:owner>
Dec 06 14:35:14 user nova-compute[75326]:       <nova:ports>
Dec 06 14:35:14 user nova-compute[75326]:         <nova:port uuid="f3bf1710-b17b-405c-bc0e-c2b46e649e48">
Dec 06 14:35:14 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 14:35:14 user nova-compute[75326]:         </nova:port>
Dec 06 14:35:14 user nova-compute[75326]:       </nova:ports>
Dec 06 14:35:14 user nova-compute[75326]:     </nova:instance>
Dec 06 14:35:14 user nova-compute[75326]:   </metadata>
Dec 06 14:35:14 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:35:14 user nova-compute[75326]:     <system>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="serial">c4a8370f-5716-4337-9f35-a9baf35253ff</entry>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="uuid">c4a8370f-5716-4337-9f35-a9baf35253ff</entry>
Dec 06 14:35:14 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:35:14 user nova-compute[75326]:     </system>
Dec 06 14:35:14 user nova-compute[75326]:   </sysinfo>
Dec 06 14:35:14 user nova-compute[75326]:   <os>
Dec 06 14:35:14 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:35:14 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:35:14 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:35:14 user nova-compute[75326]:   </os>
Dec 06 14:35:14 user nova-compute[75326]:   <features>
Dec 06 14:35:14 user nova-compute[75326]:     <acpi/>
Dec 06 14:35:14 user nova-compute[75326]:     <apic/>
Dec 06 14:35:14 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:35:14 user nova-compute[75326]:   </features>
Dec 06 14:35:14 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:35:14 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:35:14 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:35:14 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:35:14 user nova-compute[75326]:   </clock>
Dec 06 14:35:14 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:35:14 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:35:14 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:35:14 user nova-compute[75326]:   </cpu>
Dec 06 14:35:14 user nova-compute[75326]:   <devices>
Dec 06 14:35:14 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:35:14 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:35:14 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:35:14 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:35:14 user nova-compute[75326]:       <serial>5f8c694f-8217-49b5-a47c-b2d51717c953</serial>
Dec 06 14:35:14 user nova-compute[75326]:     </disk>
Dec 06 14:35:14 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:35:14 user nova-compute[75326]:       <mac address="fa:16:3e:f0:6e:48"/>
Dec 06 14:35:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:35:14 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:35:14 user nova-compute[75326]:       <target dev="tapf3bf1710-b1"/>
Dec 06 14:35:14 user nova-compute[75326]:     </interface>
Dec 06 14:35:14 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:35:14 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/c4a8370f-5716-4337-9f35-a9baf35253ff/console.log" append="off"/>
Dec 06 14:35:14 user nova-compute[75326]:     </serial>
Dec 06 14:35:14 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:35:14 user nova-compute[75326]:     <video>
Dec 06 14:35:14 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:35:14 user nova-compute[75326]:     </video>
Dec 06 14:35:14 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:35:14 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:35:14 user nova-compute[75326]:     </rng>
Dec 06 14:35:14 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:35:14 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:35:14 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:35:14 user nova-compute[75326]:     </memballoon>
Dec 06 14:35:14 user nova-compute[75326]:   </devices>
Dec 06 14:35:14 user nova-compute[75326]: </domain>
Dec 06 14:35:14 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-640653941',display_name='tempest-TestVolumeBootPattern-volume-backed-server-640653941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-640653941',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq6RdV7TRjq/zj70J30+RS7t5WsZDK4ApqS3wieWeBpcTWj7bOAAyjW4gCMVTSJMIQAauZ/LjIMRBbN5zsyI2A/4VqimEmKo1sT7HsPhcnUmC6GgfL/PC2sETylcTRRrQ==',key_name='tempest-keypair-729804187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-462xm067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:35:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c4a8370f-5716-4337-9f35-a9baf35253ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG os_vif [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1e19563-27c0-5214-b090-aa19149aa5ca', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3bf1710-b1, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3bf1710-b1, col_values=(('qos', UUID('6e5acc75-b107-47a1-b6b3-f590459867c5')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3bf1710-b1, col_values=(('external_ids', {'iface-id': 'f3bf1710-b17b-405c-bc0e-c2b46e649e48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:6e:48', 'vm-uuid': 'c4a8370f-5716-4337-9f35-a9baf35253ff'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:14 user nova-compute[75326]: INFO os_vif [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1')
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:35:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:f0:6e:48, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:35:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] No waiting events found dispatching network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:35:16 user nova-compute[75326]: WARNING nova.compute.manager [req-d4fc3424-379b-4f47-bb9f-cadfdfa2de86 req-df97d0ea-aba4-4dcb-a006-858fe35cc9ce service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received unexpected event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 for instance with vm_state building and task_state spawning.
Dec 06 14:35:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:35:18 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Instance spawned successfully.
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:35:18 user nova-compute[75326]: INFO nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Took 5.18 seconds to spawn the instance on the hypervisor.
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] No waiting events found dispatching network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:35:18 user nova-compute[75326]: WARNING nova.compute.manager [req-05a15545-a483-452f-8185-d8d56339e705 req-466e2341-97a8-4eaf-a570-5aef7b4b14f5 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received unexpected event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 for instance with vm_state building and task_state spawning.
Dec 06 14:35:18 user nova-compute[75326]: INFO nova.compute.manager [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Took 15.47 seconds to build instance.
Dec 06 14:35:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5259e103-96ae-4c0c-a6ca-b503364969ed tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.580s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:35:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:35:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:35:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:35:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.302310943603516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c4a8370f-5716-4337-9f35-a9baf35253ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:35:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:35:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:35:54 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [{"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:35:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:35:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:35:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:35:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:58 user nova-compute[75326]: INFO nova.compute.manager [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Terminating instance
Dec 06 14:35:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-unplugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] No waiting events found dispatching network-vif-unplugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-5787b219-6067-4f02-9aa8-6aad22e75a6a req-5dfe26a4-bc67-4619-a01a-fd06d54ad14d service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-unplugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Instance destroyed successfully.
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lazy-loading 'resources' on Instance uuid a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-4521818',display_name='tempest-ServerActionsTestOtherA-server-4521818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-4521818',id=23,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Ou4y+x6Qa86jo2g6QhyHQ+SG1KgaGfBb1EhoZZVxjYyw5donzOFPFuqS5QwJKxhV+12MnbxhRg8ST0L3VDqqFf+cqPwrkBJbaj0rx3gR7YLbt5XYi0ho3ZihJuJswFA==',key_name='tempest-keypair-1340083379',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:16:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcea056f8f4348118fce811a5b38bbe3',ramdisk_id='',reservation_id='r-nk28wdyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568176033',owner_user_name='tempest-ServerActionsTestOtherA-1568176033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584d6786de6449e7b07e35ca2a0a2291',uuid=a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converting VIF {"id": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "address": "fa:16:3e:ec:02:00", "network": {"id": "d02151b3-fa6d-417a-b090-8c99f48f8bde", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-487296808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcea056f8f4348118fce811a5b38bbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb497ae2a-97", "ovs_interfaceid": "b497ae2a-97d3-43e7-8741-fa8d1659aa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG os_vif [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb497ae2a-97, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1176f80-5cf5-4f7f-adb0-f927baed3fde) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:35:59 user nova-compute[75326]: INFO os_vif [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:02:00,bridge_name='br-int',has_traffic_filtering=True,id=b497ae2a-97d3-43e7-8741-fa8d1659aa69,network=Network(d02151b3-fa6d-417a-b090-8c99f48f8bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb497ae2a-97')
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Deleting instance files /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d_del
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Deletion of /opt/stack/data/nova/instances/a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d_del complete
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.compute.manager [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 14:35:59 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Took 0.46 seconds to deallocate network for instance.
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac121542-0120-4f77-9d2d-f93955f99959 req-ca02e053-a12e-4a00-b0bd-06e02faaada3 service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-deleted-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:35:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:35:59 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Deleted allocations for instance a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d
Dec 06 14:35:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1a3f13a3-ddc3-4651-9c88-629efb170a6b tempest-ServerActionsTestOtherA-1568176033 tempest-ServerActionsTestOtherA-1568176033-project-member] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:36:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] Acquiring lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] Lock "a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:00 user nova-compute[75326]: DEBUG nova.compute.manager [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] No waiting events found dispatching network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:36:00 user nova-compute[75326]: WARNING nova.compute.manager [req-4789ad2e-15ed-43cf-bf78-6f50c69d49cf req-bf566341-b8f5-4c8a-abb4-fdf43c7023ec service nova] [instance: a5ce9c2a-dade-46c9-9957-a7fb71fcbc0d] Received unexpected event network-vif-plugged-b497ae2a-97d3-43e7-8741-fa8d1659aa69 for instance with vm_state deleted and task_state None.
Dec 06 14:36:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:36:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:36:23 user nova-compute[75326]: INFO nova.compute.claims [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Claim successful on node user
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:36:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.policy [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80aee212d14c46eeb135a27b6b09b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18d7f00b9d6458c9049d7c9ee72175a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:36:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Creating image(s)
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "/opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "/opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "/opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk 1073741824" returned: 0 in 0.049s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Successfully created port: 20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Cannot resize image /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Ensure instance console log exists: /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Successfully updated port: 20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquired lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-changed-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG nova.compute.manager [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Refreshing instance network info cache due to event network-changed-20675670-975e-4679-a503-1fd893b7fe7e. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:36:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] Acquiring lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Releasing lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Instance network_info: |[{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] Acquired lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Refreshing network info cache for port 20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Start _get_guest_xml network_info=[{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:36:25 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:36:25 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1962856366',display_name='tempest-SnapshotDataIntegrityTests-server-1962856366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1962856366',id=43,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM33j0+jzE8+KOqzyFYMT2/AClOHXeL4TQp8qUKYTL95pUsP2QaHPQ20+oVLoheEGkTB6kbkpz9Rnx7n7J+nk7GtGDKSBiRdQiwdO5GZ+2kDVipsW4oeiGfVIvx5r4SPxg==',key_name='tempest-keypair-1614337769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18d7f00b9d6458c9049d7c9ee72175a',ramdisk_id='',reservation_id='r-z77mh42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1643468329',owner_user_name='tempest-SnapshotDataIntegrityTests-1643468329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80aee212d14c46eeb135a27b6b09b51d',uuid=b477da31-cfb7-48b9-a63b-cf4b6972a912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converting VIF {"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'pci_devices' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:36:25 user nova-compute[75326]:   <uuid>b477da31-cfb7-48b9-a63b-cf4b6972a912</uuid>
Dec 06 14:36:25 user nova-compute[75326]:   <name>instance-0000002b</name>
Dec 06 14:36:25 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:36:25 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:36:25 user nova-compute[75326]:   <metadata>
Dec 06 14:36:25 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:36:25 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1962856366</nova:name>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:36:25</nova:creationTime>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:36:25 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:36:25 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:owner>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:user uuid="80aee212d14c46eeb135a27b6b09b51d">tempest-SnapshotDataIntegrityTests-1643468329-project-member</nova:user>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:project uuid="a18d7f00b9d6458c9049d7c9ee72175a">tempest-SnapshotDataIntegrityTests-1643468329</nova:project>
Dec 06 14:36:25 user nova-compute[75326]:       </nova:owner>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:36:25 user nova-compute[75326]:       <nova:ports>
Dec 06 14:36:25 user nova-compute[75326]:         <nova:port uuid="20675670-975e-4679-a503-1fd893b7fe7e">
Dec 06 14:36:25 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:36:25 user nova-compute[75326]:         </nova:port>
Dec 06 14:36:25 user nova-compute[75326]:       </nova:ports>
Dec 06 14:36:25 user nova-compute[75326]:     </nova:instance>
Dec 06 14:36:25 user nova-compute[75326]:   </metadata>
Dec 06 14:36:25 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:36:25 user nova-compute[75326]:     <system>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="serial">b477da31-cfb7-48b9-a63b-cf4b6972a912</entry>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="uuid">b477da31-cfb7-48b9-a63b-cf4b6972a912</entry>
Dec 06 14:36:25 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:36:25 user nova-compute[75326]:     </system>
Dec 06 14:36:25 user nova-compute[75326]:   </sysinfo>
Dec 06 14:36:25 user nova-compute[75326]:   <os>
Dec 06 14:36:25 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:36:25 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:36:25 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:36:25 user nova-compute[75326]:   </os>
Dec 06 14:36:25 user nova-compute[75326]:   <features>
Dec 06 14:36:25 user nova-compute[75326]:     <acpi/>
Dec 06 14:36:25 user nova-compute[75326]:     <apic/>
Dec 06 14:36:25 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:36:25 user nova-compute[75326]:   </features>
Dec 06 14:36:25 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:36:25 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:36:25 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:36:25 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:36:25 user nova-compute[75326]:   </clock>
Dec 06 14:36:25 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:36:25 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:36:25 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:36:25 user nova-compute[75326]:   </cpu>
Dec 06 14:36:25 user nova-compute[75326]:   <devices>
Dec 06 14:36:25 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:36:25 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:36:25 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk"/>
Dec 06 14:36:25 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:36:25 user nova-compute[75326]:     </disk>
Dec 06 14:36:25 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:36:25 user nova-compute[75326]:       <mac address="fa:16:3e:ea:20:65"/>
Dec 06 14:36:25 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:36:25 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:36:25 user nova-compute[75326]:       <target dev="tap20675670-97"/>
Dec 06 14:36:25 user nova-compute[75326]:     </interface>
Dec 06 14:36:25 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:36:25 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/console.log" append="off"/>
Dec 06 14:36:25 user nova-compute[75326]:     </serial>
Dec 06 14:36:25 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:36:25 user nova-compute[75326]:     <video>
Dec 06 14:36:25 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:36:25 user nova-compute[75326]:     </video>
Dec 06 14:36:25 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:36:25 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:36:25 user nova-compute[75326]:     </rng>
Dec 06 14:36:25 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:36:25 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:36:25 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:36:25 user nova-compute[75326]:     </memballoon>
Dec 06 14:36:25 user nova-compute[75326]:   </devices>
Dec 06 14:36:25 user nova-compute[75326]: </domain>
Dec 06 14:36:25 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1962856366',display_name='tempest-SnapshotDataIntegrityTests-server-1962856366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1962856366',id=43,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM33j0+jzE8+KOqzyFYMT2/AClOHXeL4TQp8qUKYTL95pUsP2QaHPQ20+oVLoheEGkTB6kbkpz9Rnx7n7J+nk7GtGDKSBiRdQiwdO5GZ+2kDVipsW4oeiGfVIvx5r4SPxg==',key_name='tempest-keypair-1614337769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18d7f00b9d6458c9049d7c9ee72175a',ramdisk_id='',reservation_id='r-z77mh42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1643468329',owner_user_name='tempest-SnapshotDataIntegrityTests-1643468329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80aee212d14c46eeb135a27b6b09b51d',uuid=b477da31-cfb7-48b9-a63b-cf4b6972a912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converting VIF {"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG os_vif [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f92c5d6d-0cb0-5a8d-9478-cb0347a44427', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20675670-97, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20675670-97, col_values=(('qos', UUID('c344041d-e165-411c-a609-f7c880ba1988')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20675670-97, col_values=(('external_ids', {'iface-id': '20675670-975e-4679-a503-1fd893b7fe7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:20:65', 'vm-uuid': 'b477da31-cfb7-48b9-a63b-cf4b6972a912'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:25 user nova-compute[75326]: INFO os_vif [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97')
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No VIF found with MAC fa:16:3e:ea:20:65, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updated VIF entry in instance network info cache for port 20675670-975e-4679-a503-1fd893b7fe7e. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG nova.network.neutron [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:36:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb387bd2-deb1-4d18-8812-2085fbab0898 req-51484a53-d7f3-48a9-950b-dd781e5e35bc service nova] Releasing lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:36:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] No waiting events found dispatching network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:36:27 user nova-compute[75326]: WARNING nova.compute.manager [req-a4566a10-0e0e-4552-8834-a890c5ae9fac req-e1b817e3-6eb9-4d85-ae28-602d398fd735 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received unexpected event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e for instance with vm_state building and task_state spawning.
Dec 06 14:36:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:36:28 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Instance spawned successfully.
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:36:28 user nova-compute[75326]: INFO nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Took 5.23 seconds to spawn the instance on the hypervisor.
Dec 06 14:36:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:36:29 user nova-compute[75326]: INFO nova.compute.manager [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Took 5.74 seconds to build instance.
Dec 06 14:36:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4a555030-2ed6-4047-9b1f-1ada614456b8 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.846s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:36:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:29 user nova-compute[75326]: DEBUG nova.compute.manager [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] No waiting events found dispatching network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:36:29 user nova-compute[75326]: WARNING nova.compute.manager [req-6e0dc2cd-15dd-4bf7-b4ae-39da9424844e req-36f7844f-6dd6-4d11-9d05-4547dd95bcfd service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received unexpected event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e for instance with vm_state active and task_state None.
Dec 06 14:36:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:47 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:36:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:36:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:36:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:36:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.291431427001953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c4a8370f-5716-4337-9f35-a9baf35253ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-changed-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Refreshing instance network info cache due to event network-changed-f3bf1710-b17b-405c-bc0e-c2b46e649e48. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] Acquiring lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] Acquired lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:36:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Refreshing network info cache for port f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updated VIF entry in instance network info cache for port f3bf1710-b17b-405c-bc0e-c2b46e649e48. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c830fc1-9896-40f2-ac1a-e127f2e7587d req-fa4e6522-f163-4809-b5f6-00217f80a45c service nova] Releasing lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:36:54 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:36:55 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:36:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:36:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:36:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:36:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:36:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:37:01 user nova-compute[75326]: INFO nova.compute.claims [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Claim successful on node user
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:37:01 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.policy [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e210aa5ceae64d3988d9566f7cdc79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d50eb095a86486e878dc3b4ffc74248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:37:01 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Creating image(s)
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "/opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk 1073741824" returned: 0 in 0.083s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:37:02 user nova-compute[75326]: INFO nova.compute.claims [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Claim successful on node user
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Successfully created port: 73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.193s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Cannot resize image /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Ensure instance console log exists: /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:37:02 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:37:02 user nova-compute[75326]: INFO nova.virt.block_device [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Booting with volume snapshot 20245b3d-dc1d-44bc-9c71-a0dcf06e0268 at /dev/vda
Dec 06 14:37:02 user nova-compute[75326]: DEBUG nova.policy [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Successfully updated port: 73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-changed-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.compute.manager [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Refreshing instance network info cache due to event network-changed-73ba6825-187e-46ca-bfd0-c27a4d742c3e. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Instance network_info: |[{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Successfully created port: 405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Refreshing network info cache for port 73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Start _get_guest_xml network_info=[{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:37:03 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:03 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1025196629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1025196629',id=44,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-udelrh3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:37:02Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=4710df1b-4bf9-4448-85ae-2ef8a7797f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:37:03 user nova-compute[75326]:   <uuid>4710df1b-4bf9-4448-85ae-2ef8a7797f49</uuid>
Dec 06 14:37:03 user nova-compute[75326]:   <name>instance-0000002c</name>
Dec 06 14:37:03 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:37:03 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:37:03 user nova-compute[75326]:   <metadata>
Dec 06 14:37:03 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:37:03 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1025196629</nova:name>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:37:03</nova:creationTime>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:37:03 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:37:03 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:owner>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:37:03 user nova-compute[75326]:       </nova:owner>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:37:03 user nova-compute[75326]:       <nova:ports>
Dec 06 14:37:03 user nova-compute[75326]:         <nova:port uuid="73ba6825-187e-46ca-bfd0-c27a4d742c3e">
Dec 06 14:37:03 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 14:37:03 user nova-compute[75326]:         </nova:port>
Dec 06 14:37:03 user nova-compute[75326]:       </nova:ports>
Dec 06 14:37:03 user nova-compute[75326]:     </nova:instance>
Dec 06 14:37:03 user nova-compute[75326]:   </metadata>
Dec 06 14:37:03 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:37:03 user nova-compute[75326]:     <system>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="serial">4710df1b-4bf9-4448-85ae-2ef8a7797f49</entry>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="uuid">4710df1b-4bf9-4448-85ae-2ef8a7797f49</entry>
Dec 06 14:37:03 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:37:03 user nova-compute[75326]:     </system>
Dec 06 14:37:03 user nova-compute[75326]:   </sysinfo>
Dec 06 14:37:03 user nova-compute[75326]:   <os>
Dec 06 14:37:03 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:37:03 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:37:03 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:37:03 user nova-compute[75326]:   </os>
Dec 06 14:37:03 user nova-compute[75326]:   <features>
Dec 06 14:37:03 user nova-compute[75326]:     <acpi/>
Dec 06 14:37:03 user nova-compute[75326]:     <apic/>
Dec 06 14:37:03 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:37:03 user nova-compute[75326]:   </features>
Dec 06 14:37:03 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:37:03 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:37:03 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:37:03 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:37:03 user nova-compute[75326]:   </clock>
Dec 06 14:37:03 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:37:03 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:37:03 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:37:03 user nova-compute[75326]:   </cpu>
Dec 06 14:37:03 user nova-compute[75326]:   <devices>
Dec 06 14:37:03 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:37:03 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:37:03 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk"/>
Dec 06 14:37:03 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:37:03 user nova-compute[75326]:     </disk>
Dec 06 14:37:03 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:37:03 user nova-compute[75326]:       <mac address="fa:16:3e:8c:40:bf"/>
Dec 06 14:37:03 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:37:03 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:37:03 user nova-compute[75326]:       <target dev="tap73ba6825-18"/>
Dec 06 14:37:03 user nova-compute[75326]:     </interface>
Dec 06 14:37:03 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:37:03 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/console.log" append="off"/>
Dec 06 14:37:03 user nova-compute[75326]:     </serial>
Dec 06 14:37:03 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:37:03 user nova-compute[75326]:     <video>
Dec 06 14:37:03 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:37:03 user nova-compute[75326]:     </video>
Dec 06 14:37:03 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:37:03 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:37:03 user nova-compute[75326]:     </rng>
Dec 06 14:37:03 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:37:03 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:37:03 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:37:03 user nova-compute[75326]:     </memballoon>
Dec 06 14:37:03 user nova-compute[75326]:   </devices>
Dec 06 14:37:03 user nova-compute[75326]: </domain>
Dec 06 14:37:03 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1025196629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1025196629',id=44,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-udelrh3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:37:02Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=4710df1b-4bf9-4448-85ae-2ef8a7797f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG os_vif [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c9be4ea-eb7c-5b71-acc7-c823b9c0024d', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73ba6825-18, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73ba6825-18, col_values=(('qos', UUID('9a4cf1ba-a9e8-4179-9c37-5166b9e437ad')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73ba6825-18, col_values=(('external_ids', {'iface-id': '73ba6825-187e-46ca-bfd0-c27a4d742c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:40:bf', 'vm-uuid': '4710df1b-4bf9-4448-85ae-2ef8a7797f49'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:03 user nova-compute[75326]: INFO os_vif [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18')
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:8c:40:bf, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated VIF entry in instance network info cache for port 73ba6825-187e-46ca-bfd0-c27a4d742c3e. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG nova.network.neutron [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:37:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f4762468-5971-4e5b-a3c9-d64399b4fb66 req-4833d8b3-49cb-4db7-a4a9-d03202d214ac service nova] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Successfully updated port: 405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-changed-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.compute.manager [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Refreshing instance network info cache due to event network-changed-405b1de6-fd72-48fc-a951-33a20f53f3d1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] Acquiring lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.network.neutron [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updating instance_info_cache with network_info: [{"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Instance network_info: |[{"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] Acquired lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG nova.network.neutron [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Refreshing network info cache for port 405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:37:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updated VIF entry in instance network info cache for port 405b1de6-fd72-48fc-a951-33a20f53f3d1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG nova.network.neutron [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updating instance_info_cache with network_info: [{"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a863c691-d6bf-493f-8a99-35f60a02d405 req-34145eb4-462c-44d3-8855-a6d3fb324347 service nova] Releasing lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] No waiting events found dispatching network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:37:06 user nova-compute[75326]: WARNING nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received unexpected event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e for instance with vm_state building and task_state spawning.
Dec 06 14:37:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] No waiting events found dispatching network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:37:06 user nova-compute[75326]: WARNING nova.compute.manager [req-c414dac2-16c7-4276-a37f-ccfed94489dc req-4b1b61b6-e547-4aec-b72f-7790a3c34cc8 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received unexpected event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e for instance with vm_state building and task_state spawning.
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:37:07 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Instance spawned successfully.
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:07 user nova-compute[75326]: INFO nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Took 5.66 seconds to spawn the instance on the hypervisor.
Dec 06 14:37:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:37:07 user nova-compute[75326]: INFO nova.compute.manager [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Took 6.32 seconds to build instance.
Dec 06 14:37:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7013adaa-eec3-4a23-9f8c-57f33d3a4121 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.410s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.utils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d85fad-3ef0-4b6c-bcf1-413b1bbeb0e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bbb7ea-0bde-487e-ae35-49b913b1c3b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47adcff4-0145-4072-a9cb-c4170bb48d8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aaa164-f7a3-451b-bd42-339b701f6270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:37:08 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:37:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccebaab-a7a3-4f1e-96ed-f8bde1f2878c]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG os_brick.utils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:37:08 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updating existing volume attachment record: af73a874-7239-4e56-a80f-86f81c6d0b3c {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:37:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:37:22 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Creating image(s)
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Ensure instance console log exists: /opt/stack/data/nova/instances/b540fe2b-6ab7-42bf-9970-6932f57f2717/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Start _get_guest_xml network_info=[{"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T14:36:56Z,direct_url=<?>,disk_format='qcow2',id=5548eb1d-cc8c-4d9f-bc24-47cf9725d31d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1463612279',owner='06dc9e14dea14190a9d6afd7fe48ea18',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T14:36:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'af73a874-7239-4e56-a80f-86f81c6d0b3c', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhFPQJBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b540fe2b-6ab7-42bf-9970-6932f57f2717', 'attached_at': '', 'detached_at': '', 'volume_id': 'af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 'serial': 'af2a0e71-3772-4a3a-a46b-5dc32ebe1915'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:37:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T14:36:56Z,direct_url=<?>,disk_format='qcow2',id=5548eb1d-cc8c-4d9f-bc24-47cf9725d31d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1463612279',owner='06dc9e14dea14190a9d6afd7fe48ea18',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T14:36:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhFPQJBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:37:22 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:37:22 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:37:22 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f376b8-7067-478a-8615-05c673567db7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:37:22 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a0652f-dff4-4440-9833-b9d93a28cb19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915] added
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d698b-074b-42f6-99fc-cdb6c356578d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e1e84-29d1-43ed-ae50-5c129f174ae7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhFPQJBd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhFPQJBd" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e945b768-56dd-4f7d-b2a6-b1fd91678976]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhFPQJBd'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81ee216-15e7-4d43-a464-57ec12d50c49]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c12e67d-62d2-4e4a-b1e7-a7a7d0bd5462]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e95110-0a7b-4d4b-b418-be6e5145117f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260]
Dec 06 14:37:22 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260] successful.
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[88442fc1-cfff-4f23-a78d-9a29e1a0872d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d21c00-a0a8-41d1-b4e0-d48556c9622e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:37:22 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9beea5-59db-4f8b-8e53-eaf0c1ab4a25]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:37:22 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhFPQJBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23665646139373461', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665646139373461', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-57311798',id=45,image_ref='5548eb1d-cc8c-4d9f-bc24-47cf9725d31d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB2QQHKkFnbe1izq0DIfrSbZXtOUyNtnQy8xNJzR0v4vaePOWTLWbFG3kJgIYDbbwd81vzzUJcyD9kwet882/lAJv8Eop7hJW/qQbzkGGflgkJwlYEclpsuk9eBmwEe7Q==',key_name='tempest-keypair-1006037194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-fll1mw8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-582175585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=b540fe2b-6ab7-42bf-9970-6932f57f2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid b540fe2b-6ab7-42bf-9970-6932f57f2717 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:37:23 user nova-compute[75326]:   <uuid>b540fe2b-6ab7-42bf-9970-6932f57f2717</uuid>
Dec 06 14:37:23 user nova-compute[75326]:   <name>instance-0000002d</name>
Dec 06 14:37:23 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:37:23 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:37:23 user nova-compute[75326]:   <metadata>
Dec 06 14:37:23 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:37:23 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-57311798</nova:name>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:37:22</nova:creationTime>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:37:23 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:37:23 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:owner>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:37:23 user nova-compute[75326]:       </nova:owner>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:root type="image" uuid="5548eb1d-cc8c-4d9f-bc24-47cf9725d31d"/>
Dec 06 14:37:23 user nova-compute[75326]:       <nova:ports>
Dec 06 14:37:23 user nova-compute[75326]:         <nova:port uuid="405b1de6-fd72-48fc-a951-33a20f53f3d1">
Dec 06 14:37:23 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 14:37:23 user nova-compute[75326]:         </nova:port>
Dec 06 14:37:23 user nova-compute[75326]:       </nova:ports>
Dec 06 14:37:23 user nova-compute[75326]:     </nova:instance>
Dec 06 14:37:23 user nova-compute[75326]:   </metadata>
Dec 06 14:37:23 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:37:23 user nova-compute[75326]:     <system>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="serial">b540fe2b-6ab7-42bf-9970-6932f57f2717</entry>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="uuid">b540fe2b-6ab7-42bf-9970-6932f57f2717</entry>
Dec 06 14:37:23 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:37:23 user nova-compute[75326]:     </system>
Dec 06 14:37:23 user nova-compute[75326]:   </sysinfo>
Dec 06 14:37:23 user nova-compute[75326]:   <os>
Dec 06 14:37:23 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:37:23 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:37:23 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:37:23 user nova-compute[75326]:   </os>
Dec 06 14:37:23 user nova-compute[75326]:   <features>
Dec 06 14:37:23 user nova-compute[75326]:     <acpi/>
Dec 06 14:37:23 user nova-compute[75326]:     <apic/>
Dec 06 14:37:23 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:37:23 user nova-compute[75326]:   </features>
Dec 06 14:37:23 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:37:23 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:37:23 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:37:23 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:37:23 user nova-compute[75326]:   </clock>
Dec 06 14:37:23 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:37:23 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:37:23 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:37:23 user nova-compute[75326]:   </cpu>
Dec 06 14:37:23 user nova-compute[75326]:   <devices>
Dec 06 14:37:23 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:37:23 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:37:23 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:37:23 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:37:23 user nova-compute[75326]:       <serial>af2a0e71-3772-4a3a-a46b-5dc32ebe1915</serial>
Dec 06 14:37:23 user nova-compute[75326]:     </disk>
Dec 06 14:37:23 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:37:23 user nova-compute[75326]:       <mac address="fa:16:3e:13:63:de"/>
Dec 06 14:37:23 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:37:23 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:37:23 user nova-compute[75326]:       <target dev="tap405b1de6-fd"/>
Dec 06 14:37:23 user nova-compute[75326]:     </interface>
Dec 06 14:37:23 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:37:23 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/b540fe2b-6ab7-42bf-9970-6932f57f2717/console.log" append="off"/>
Dec 06 14:37:23 user nova-compute[75326]:     </serial>
Dec 06 14:37:23 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:37:23 user nova-compute[75326]:     <video>
Dec 06 14:37:23 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:37:23 user nova-compute[75326]:     </video>
Dec 06 14:37:23 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:37:23 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:37:23 user nova-compute[75326]:     </rng>
Dec 06 14:37:23 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:37:23 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:37:23 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:37:23 user nova-compute[75326]:     </memballoon>
Dec 06 14:37:23 user nova-compute[75326]:   </devices>
Dec 06 14:37:23 user nova-compute[75326]: </domain>
Dec 06 14:37:23 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-57311798',id=45,image_ref='5548eb1d-cc8c-4d9f-bc24-47cf9725d31d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB2QQHKkFnbe1izq0DIfrSbZXtOUyNtnQy8xNJzR0v4vaePOWTLWbFG3kJgIYDbbwd81vzzUJcyD9kwet882/lAJv8Eop7hJW/qQbzkGGflgkJwlYEclpsuk9eBmwEe7Q==',key_name='tempest-keypair-1006037194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-fll1mw8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-582175585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=b540fe2b-6ab7-42bf-9970-6932f57f2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG os_vif [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1229847e-3a1b-5b78-95b9-bd0679a81efa', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405b1de6-fd, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap405b1de6-fd, col_values=(('qos', UUID('29699a2a-05bb-4ff6-8236-e236cb3003b1')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap405b1de6-fd, col_values=(('external_ids', {'iface-id': '405b1de6-fd72-48fc-a951-33a20f53f3d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:63:de', 'vm-uuid': 'b540fe2b-6ab7-42bf-9970-6932f57f2717'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:37:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:23 user nova-compute[75326]: INFO os_vif [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd')
Dec 06 14:37:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:37:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:13:63:de, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:37:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] No waiting events found dispatching network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:37:25 user nova-compute[75326]: WARNING nova.compute.manager [req-94c17361-1348-4896-8a21-eba9340456a9 req-9856b5fb-e4ce-420a-bff5-4503b88d9f05 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received unexpected event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 for instance with vm_state building and task_state spawning.
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:37:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Instance spawned successfully.
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:37:27 user nova-compute[75326]: INFO nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Took 4.94 seconds to spawn the instance on the hypervisor.
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:37:27 user nova-compute[75326]: INFO nova.compute.manager [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Took 25.38 seconds to build instance.
Dec 06 14:37:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-cd58d787-1282-4a0e-bfc9-2a07db6535bf tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.536s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:27 user nova-compute[75326]: DEBUG nova.compute.manager [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] No waiting events found dispatching network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:37:27 user nova-compute[75326]: WARNING nova.compute.manager [req-04350e9f-3bd1-4047-ba78-f3ef133adef2 req-20585913-96ed-4fbe-97b5-13323588c88c service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received unexpected event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 for instance with vm_state active and task_state None.
Dec 06 14:37:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:46 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:48 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:37:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid c4a8370f-5716-4337-9f35-a9baf35253ff {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [{"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-c4a8370f-5716-4337-9f35-a9baf35253ff" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:53 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:37:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:37:55 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:55 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=25.259796142578125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c4a8370f-5716-4337-9f35-a9baf35253ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b540fe2b-6ab7-42bf-9970-6932f57f2717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:37:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:37:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:37:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:37:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:37:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:38:08 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:38:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-changed-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Refreshing instance network info cache due to event network-changed-20675670-975e-4679-a503-1fd893b7fe7e. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] Acquiring lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] Acquired lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Refreshing network info cache for port 20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updated VIF entry in instance network info cache for port 20675670-975e-4679-a503-1fd893b7fe7e. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG nova.network.neutron [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:38:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e9d8375b-e068-47f2-965e-ab7c6e216528 req-057232a5-fa23-4d36-9f7c-05f96a7a049f service nova] Releasing lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:38:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG nova.objects.instance [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:17 user nova-compute[75326]: INFO nova.compute.manager [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attaching volume 3e32d7d4-dfaa-4a0c-90ed-722375984b4e to /dev/vdb
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.utils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b43f3d6-fbea-46f6-9f2b-e88ce8876ed4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[59425519-8b00-415c-a924-bb3494ad5175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec7a58-8878-472b-a199-67efa7fefcbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fce9b1-3813-4428-ba0d-7033d6d6f694]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:38:17 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:38:17 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca5818-2803-4350-8527-06d0416756f1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG os_brick.utils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:38:17 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating existing volume attachment record: cc8a8017-1da4-4c1f-bfa8-7a5fb82538f4 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:38:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sknmDWcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:38:27 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:38:27 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:38:27 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b71c7d-d11c-4488-87fa-555aba267f4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:38:27 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[009be041-3399-42ec-a3cb-1fd393754745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e] added
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a7741-6494-4e99-b0f7-107952667bb2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15703d-f909-426b-9e1c-b91e7d2f24b5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sknmDWcQ {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sknmDWcQ" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ecdb57-77f9-4508-823e-eb8895a00520]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sknmDWcQ'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afdb76-ef61-42c0-a2aa-6734780acf7e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8848b1a-cf8e-4249-b101-9d731f0173ef]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd73faf5-7d1c-4a78-90e6-b8db6f7be699]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260]
Dec 06 14:38:27 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260] successful.
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e00b99a-29c5-4573-a4a3-d4a41fd81f5e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ada4c3-d59b-4c1c-8120-4ff38f59692c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:27 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:38:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[424ebb4a-87a3-4014-afc7-7655513b6e20]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sknmDWcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23862336564323564', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862336564323564', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:38:28 user nova-compute[75326]: DEBUG nova.objects.instance [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:38:29 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:38:29 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:38:29 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:38:29 user nova-compute[75326]:   <serial>3e32d7d4-dfaa-4a0c-90ed-722375984b4e</serial>
Dec 06 14:38:29 user nova-compute[75326]: </disk>
Dec 06 14:38:29 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No VIF found with MAC fa:16:3e:ea:20:65, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:38:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-af9e4312-7fec-403a-822d-49b6934e29ec tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.780s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:46 user nova-compute[75326]: INFO nova.compute.manager [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Detaching volume 3e32d7d4-dfaa-4a0c-90ed-722375984b4e
Dec 06 14:38:46 user nova-compute[75326]: INFO nova.virt.block_device [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attempting to driver detach volume 3e32d7d4-dfaa-4a0c-90ed-722375984b4e from mountpoint /dev/vdb
Dec 06 14:38:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Attempting to detach device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:38:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:38:46 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:38:46 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:38:46 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:38:46 user nova-compute[75326]:   <serial>3e32d7d4-dfaa-4a0c-90ed-722375984b4e</serial>
Dec 06 14:38:46 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:38:46 user nova-compute[75326]: </disk>
Dec 06 14:38:46 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:38:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config.
Dec 06 14:38:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:38:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:38:46 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:38:46 user nova-compute[75326]:   <source dev="/dev/sdd"/>
Dec 06 14:38:46 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:38:46 user nova-compute[75326]:   <serial>3e32d7d4-dfaa-4a0c-90ed-722375984b4e</serial>
Dec 06 14:38:46 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:38:46 user nova-compute[75326]: </disk>
Dec 06 14:38:46 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:38:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:38:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:38:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:38:51 user nova-compute[75326]: INFO nova.compute.manager [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] instance snapshotting
Dec 06 14:38:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Beginning live snapshot process
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6.delta 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6.delta 1073741824" returned: 0 in 0.054s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-changed-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Refreshing instance network info cache due to event network-changed-405b1de6-fd72-48fc-a951-33a20f53f3d1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] Acquiring lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] Acquired lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Refreshing network info cache for port 405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updated VIF entry in instance network info cache for port 405b1de6-fd72-48fc-a951-33a20f53f3d1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.network.neutron [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updating instance_info_cache with network_info: [{"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-a32eae6c-e610-4f7c-948d-d0db904b2fcc req-d01a6584-7903-4dd1-a6ca-74c4bb9cb17d service nova] Releasing lock "refresh_cache-b540fe2b-6ab7-42bf-9970-6932f57f2717" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:53 user nova-compute[75326]: INFO nova.compute.manager [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Terminating instance
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:38:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:38:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6.delta /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6.delta /opt/stack/data/nova/instances/snapshots/tmp0y3qwzp2/f5ca1f2276274e43806bb9706a3cc8b6" returned: 0 in 0.583s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Snapshot extracted, beginning image upload
Dec 06 14:38:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Instance destroyed successfully.
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid b540fe2b-6ab7-42bf-9970-6932f57f2717 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-57311798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-57311798',id=45,image_ref='5548eb1d-cc8c-4d9f-bc24-47cf9725d31d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB2QQHKkFnbe1izq0DIfrSbZXtOUyNtnQy8xNJzR0v4vaePOWTLWbFG3kJgIYDbbwd81vzzUJcyD9kwet882/lAJv8Eop7hJW/qQbzkGGflgkJwlYEclpsuk9eBmwEe7Q==',key_name='tempest-keypair-1006037194',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-fll1mw8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-582175585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=b540fe2b-6ab7-42bf-9970-6932f57f2717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "address": "fa:16:3e:13:63:de", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405b1de6-fd", "ovs_interfaceid": "405b1de6-fd72-48fc-a951-33a20f53f3d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_vif [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405b1de6-fd, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29699a2a-05bb-4ff6-8236-e236cb3003b1) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:38:54 user nova-compute[75326]: INFO os_vif [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:63:de,bridge_name='br-int',has_traffic_filtering=True,id=405b1de6-fd72-48fc-a951-33a20f53f3d1,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405b1de6-fd')
Dec 06 14:38:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhFPQJBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:38:54 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ea04e-f782-4b87-b417-f4567efac86f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:38:54 user nova-compute[75326]: No targets found.
Dec 06 14:38:54 user nova-compute[75326]: iSNS:
Dec 06 14:38:54 user nova-compute[75326]: No targets found.
Dec 06 14:38:54 user nova-compute[75326]: STATIC:
Dec 06 14:38:54 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953
Dec 06 14:38:54 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:38:54 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:38:54 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e
Dec 06 14:38:54 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:38:54 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:38:54 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915
Dec 06 14:38:54 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:38:54 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:38:54 user nova-compute[75326]: FIRMWARE:
Dec 06 14:38:54 user nova-compute[75326]: No targets found.
Dec 06 14:38:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:38:54 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:38:54 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c71662a-a0d9-4a87-8363-9d424682b26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e7ef5-7642-4ede-ad88-734972130126]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:54 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:54 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:38:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:38:54 user nova-compute[75326]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 (non-flash)
Dec 06 14:38:54 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:38:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44ddab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51288f4c-0a75-44cc-9456-c5ea1902cb14]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de5703-3670-4965-9035-2cda34a002f7]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4d4598-4683-4db6-8383-cc2f7ea8b8dc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:38:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b636a250-9fdc-46ac-ad31-a080f9c3e483]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb92e30-f99d-4cc8-8322-300a6038f560]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b4ea82-c8f9-440b-8056-ccdb0b2f587d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260]
Dec 06 14:38:55 user nova-compute[75326]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915, portal: 172.16.0.220,3260] successful.
Dec 06 14:38:55 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af2a0e71-3772-4a3a-a46b-5dc32ebe1915 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0cc08-0861-43a1-b570-f6d4d6e2b6e3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (337ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:38:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Deleting instance files /opt/stack/data/nova/instances/b540fe2b-6ab7-42bf-9970-6932f57f2717_del
Dec 06 14:38:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Deletion of /opt/stack/data/nova/instances/b540fe2b-6ab7-42bf-9970-6932f57f2717_del complete
Dec 06 14:38:55 user nova-compute[75326]: INFO nova.compute.manager [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Took 1.21 seconds to destroy the instance on the hypervisor.
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-unplugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] No waiting events found dispatching network-vif-unplugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-unplugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Acquiring lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] No waiting events found dispatching network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:38:55 user nova-compute[75326]: WARNING nova.compute.manager [req-03af2875-0e69-4d0a-888e-254a23623beb req-dbdba61c-0ea2-4769-b6ba-91836050d4f8 service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received unexpected event network-vif-plugged-405b1de6-fd72-48fc-a951-33a20f53f3d1 for instance with vm_state active and task_state deleting.
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:38:55 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:38:55 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Took 0.75 seconds to deallocate network for instance.
Dec 06 14:38:56 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:38:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:38:57 user nova-compute[75326]: INFO nova.compute.manager [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Took 1.36 seconds to detach 1 volumes for instance.
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Deleting volume: af2a0e71-3772-4a3a-a46b-5dc32ebe1915 {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-b15d10b6-dd94-4ab2-ba67-187a9a5b82da req-dd32eb03-8c82-4126-b87a-1d2768bc635d service nova] [instance: b540fe2b-6ab7-42bf-9970-6932f57f2717] Received event network-vif-deleted-405b1de6-fd72-48fc-a951-33a20f53f3d1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:38:57 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:38:57 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.209293365478516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Snapshot image upload complete
Dec 06 14:38:57 user nova-compute[75326]: INFO nova.compute.manager [None req-2d0a8711-1713-461e-874c-b779f1769bd7 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Took 5.45 seconds to snapshot the instance on the hypervisor.
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c4a8370f-5716-4337-9f35-a9baf35253ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b540fe2b-6ab7-42bf-9970-6932f57f2717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.305s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:38:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:57 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance b540fe2b-6ab7-42bf-9970-6932f57f2717
Dec 06 14:38:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1c8efe7d-323c-4e72-a383-d6ad4ee54dea tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "b540fe2b-6ab7-42bf-9970-6932f57f2717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.081s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:38:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:07 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 is timed out.
Dec 06 14:39:07 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config.
Dec 06 14:39:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sknmDWcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:39:07 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b254e-476b-4ff0-b967-d84800a104c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:39:07 user nova-compute[75326]: No targets found.
Dec 06 14:39:07 user nova-compute[75326]: iSNS:
Dec 06 14:39:07 user nova-compute[75326]: No targets found.
Dec 06 14:39:07 user nova-compute[75326]: STATIC:
Dec 06 14:39:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953
Dec 06 14:39:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:39:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:39:07 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e
Dec 06 14:39:07 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:39:07 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:39:07 user nova-compute[75326]: FIRMWARE:
Dec 06 14:39:07 user nova-compute[75326]: No targets found.
Dec 06 14:39:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:39:07 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:39:07 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3197cf92-c28a-4692-8df2-bb116848b17e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98d6b8-0531-4f6a-9765-427c28d156d7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:07 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:39:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:07 user nova-compute[75326]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e (non-flash)
Dec 06 14:39:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44dce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[538aa036-a46a-4c8a-93a9-9be06f914aac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec100d-e18b-42b6-b1a5-56cc74d766ba]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393df3c-7eb5-4b53-9dac-bcfefe743a9c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c9be7-4bba-4278-a493-654165488646]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f9a252-92a2-4e0d-b54a-ce4675bfdc0b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02fd0e0-7b74-467d-abf5-10e2593ecbc1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260]
Dec 06 14:39:07 user nova-compute[75326]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e, portal: 172.16.0.220,3260] successful.
Dec 06 14:39:07 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e32d7d4-dfaa-4a0c-90ed-722375984b4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4ee99-cc05-4f8a-bc51-6f9a31cc4a1f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== disconnect_volume: return (292ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:39:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:39:08 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:39:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ac711afe-867a-4a82-ad81-8ddf54533d7d tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:39:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG nova.objects.instance [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:40 user nova-compute[75326]: INFO nova.compute.manager [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attaching volume 4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 to /dev/vdb
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.utils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc922c5-6529-4918-805d-18389ce75df2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fd7e33-2644-40fa-bc9d-07254012a671]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d9a3e-fdd2-43d4-a910-9d5a8914b10c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290fd81-807f-48cc-9e56-fa0806d69f88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:39:40 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:39:40 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0db8a6-2985-4798-afa1-4c5d6d484f50]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG os_brick.utils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:39:40 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating existing volume attachment record: 554079c3-c05b-4235-85aa-4ddd442b07de {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:39:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:49 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:39:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:39:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNYwmciX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:39:54 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:39:54 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:39:54 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270edc5-0769-44b2-a3ab-ef333d663771]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:39:54 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2df93e-ee05-48bd-ade5-961fef89f4e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7] added
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38000d98-a4ed-45be-9a2c-4532e7da4d80]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bdaac-1987-4348-9e53-f2a92cc507f7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNYwmciX {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNYwmciX" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efae4c6-b30e-4b2f-9d8d-e10745d1e070]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNYwmciX'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: INFO nova.compute.manager [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Terminating instance
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eeffae-5007-424a-9ddd-e7422575ca31]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b012ba-4f60-4db0-b29c-cbcc33299a05]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9970c-50b6-402c-9c58-5d111f40b1c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260]
Dec 06 14:39:54 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260] successful.
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be52fdf-ce0a-4011-9f74-d5a6819bee66]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ad937-096a-4dc2-9685-cd3f57efc9e9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:39:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:39:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc56ea5-6f04-4044-9dbf-1958fae116ef]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNYwmciX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-unplugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] No waiting events found dispatching network-vif-unplugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-01f0dcc5-80e5-4652-b7bd-aa9cf01384eb req-b78a6a70-8c4c-4d88-9a25-11d6ef7bc602 service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-unplugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:55 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Instance destroyed successfully.
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.objects.instance [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid c4a8370f-5716-4337-9f35-a9baf35253ff {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-640653941',display_name='tempest-TestVolumeBootPattern-volume-backed-server-640653941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-640653941',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq6RdV7TRjq/zj70J30+RS7t5WsZDK4ApqS3wieWeBpcTWj7bOAAyjW4gCMVTSJMIQAauZ/LjIMRBbN5zsyI2A/4VqimEmKo1sT7HsPhcnUmC6GgfL/PC2sETylcTRRrQ==',key_name='tempest-keypair-729804187',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-462xm067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=c4a8370f-5716-4337-9f35-a9baf35253ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "address": "fa:16:3e:f0:6e:48", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bf1710-b1", "ovs_interfaceid": "f3bf1710-b17b-405c-bc0e-c2b46e649e48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG os_vif [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3bf1710-b1, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e5acc75-b107-47a1-b6b3-f590459867c5) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:39:55 user nova-compute[75326]: INFO os_vif [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bf1710-b17b-405c-bc0e-c2b46e649e48,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bf1710-b1')
Dec 06 14:39:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:39:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDOoRrtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:39:55 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:39:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26561613031663938', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561613031663938', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.394s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.objects.instance [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a49d0a-f412-4fa0-8188-e64a9e930acf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:39:56 user nova-compute[75326]: No targets found.
Dec 06 14:39:56 user nova-compute[75326]: iSNS:
Dec 06 14:39:56 user nova-compute[75326]: No targets found.
Dec 06 14:39:56 user nova-compute[75326]: STATIC:
Dec 06 14:39:56 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953
Dec 06 14:39:56 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:39:56 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:39:56 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7
Dec 06 14:39:56 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:39:56 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:39:56 user nova-compute[75326]: FIRMWARE:
Dec 06 14:39:56 user nova-compute[75326]: No targets found.
Dec 06 14:39:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:39:56 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:39:56 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:39:56 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:39:56 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:39:56 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:39:56 user nova-compute[75326]:   <serial>4c590bd8-c28c-42d1-9ebe-1a8d86387eb7</serial>
Dec 06 14:39:56 user nova-compute[75326]: </disk>
Dec 06 14:39:56 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f357b3-b02b-4232-9c5b-541426a74176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f553ca9-bc80-4813-844b-6540ddc90989]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:56 user nova-compute[75326]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:39:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 (non-flash)
Dec 06 14:39:56 user nova-compute[75326]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:39:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd7d89fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[934463f2-22c0-413b-bbe6-0d77ea6b130b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37104d1-b15e-40a7-943d-5232ca955561]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb0459-54c5-41ea-a3e9-8c85aebef8a9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b478384-b720-44bc-a69e-337437ccb181]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[521eb0aa-a825-4d5d-a043-46348f945199]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b7ba7-dd49-49cc-a46a-da060ff7ad4d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260]
Dec 06 14:39:56 user nova-compute[75326]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953, portal: 172.16.0.220,3260] successful.
Dec 06 14:39:56 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8c694f-8217-49b5-a47c-b2d51717c953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc0841e-f46e-4923-b87a-81cb9df82ade]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (692ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:39:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Deleting instance files /opt/stack/data/nova/instances/c4a8370f-5716-4337-9f35-a9baf35253ff_del
Dec 06 14:39:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Deletion of /opt/stack/data/nova/instances/c4a8370f-5716-4337-9f35-a9baf35253ff_del complete
Dec 06 14:39:56 user nova-compute[75326]: INFO nova.compute.manager [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Took 1.58 seconds to destroy the instance on the hypervisor.
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No VIF found with MAC fa:16:3e:ea:20:65, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:39:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-68613d87-c7fb-40db-8c47-8c89d5c59048 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.050s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:39:57 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Took 0.70 seconds to deallocate network for instance.
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-93f1c5c2-1d14-486c-b034-56785b778278 req-c91552d1-8384-4f7c-9dd2-1ce4a22e477b service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-deleted-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] Acquiring lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] No waiting events found dispatching network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:39:57 user nova-compute[75326]: WARNING nova.compute.manager [req-5110a1b2-595d-4dac-9c2b-9bccd43e2cde req-b24975e4-780e-4d1f-98ee-d838ff65763d service nova] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Received unexpected event network-vif-plugged-f3bf1710-b17b-405c-bc0e-c2b46e649e48 for instance with vm_state active and task_state deleting.
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:57 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:39:58 user nova-compute[75326]: INFO nova.compute.manager [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Took 0.92 seconds to detach 1 volumes for instance.
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: c4a8370f-5716-4337-9f35-a9baf35253ff] Deleting volume: 5f8c694f-8217-49b5-a47c-b2d51717c953 {{(pid=75326) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:58 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance c4a8370f-5716-4337-9f35-a9baf35253ff
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-faa65327-96c9-435f-b606-05eed553eb29 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "c4a8370f-5716-4337-9f35-a9baf35253ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.731s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:58 user nova-compute[75326]: INFO nova.compute.manager [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Detaching volume 4c590bd8-c28c-42d1-9ebe-1a8d86387eb7
Dec 06 14:39:58 user nova-compute[75326]: INFO nova.virt.block_device [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attempting to driver detach volume 4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 from mountpoint /dev/vdb
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Attempting to detach device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:39:58 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:39:58 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:39:58 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:39:58 user nova-compute[75326]:   <serial>4c590bd8-c28c-42d1-9ebe-1a8d86387eb7</serial>
Dec 06 14:39:58 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:39:58 user nova-compute[75326]: </disk>
Dec 06 14:39:58 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:39:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config.
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:39:58 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:39:58 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:39:58 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:39:58 user nova-compute[75326]:   <serial>4c590bd8-c28c-42d1-9ebe-1a8d86387eb7</serial>
Dec 06 14:39:58 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:39:58 user nova-compute[75326]: </disk>
Dec 06 14:39:58 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:39:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:39:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:39:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.200054168701172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.055s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:39:59 user nova-compute[75326]: INFO nova.compute.claims [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Claim successful on node user
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:39:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:40:00 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:40:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:40:00 user nova-compute[75326]: DEBUG nova.policy [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e210aa5ceae64d3988d9566f7cdc79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d50eb095a86486e878dc3b4ffc74248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:40:00 user nova-compute[75326]: INFO nova.virt.block_device [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Booting with blank volume at /dev/vda
Dec 06 14:40:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:00 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Successfully created port: 0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Successfully updated port: 0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-changed-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.compute.manager [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Refreshing instance network info cache due to event network-changed-0c4885e7-2139-422c-9f3b-f33cbc5b38db. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.network.neutron [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance network_info: |[{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:40:01 user nova-compute[75326]: DEBUG nova.network.neutron [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Refreshing network info cache for port 0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:40:02 user nova-compute[75326]: DEBUG nova.network.neutron [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updated VIF entry in instance network info cache for port 0c4885e7-2139-422c-9f3b-f33cbc5b38db. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:40:02 user nova-compute[75326]: DEBUG nova.network.neutron [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:40:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e248d173-f495-41b8-a8a7-3138352b92de req-3be1e8c7-f568-4757-8558-81736bb50c84 service nova] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.utils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acb0cd-6c10-4409-afcc-06aa046274eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2210eabc-8e04-450d-899c-66e0dfe5be73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1162a565-bb61-4f25-bef6-bbe5ee326bad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcb150-173f-4249-8520-e2975aa792d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:05 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:40:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252e329-2162-4c0b-af2f-a2d9c14714dd]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG os_brick.utils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:40:05 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating existing volume attachment record: 34b8f41d-f406-4bb5-a0c1-26a91da9b73e {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:40:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:40:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Creating image(s)
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Ensure instance console log exists: /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start _get_guest_xml network_info=[{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '34b8f41d-f406-4bb5-a0c1-26a91da9b73e', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '599dcc7b-ac21-4c3a-ad14-3412d5d19365', 'attached_at': '', 'detached_at': '', 'volume_id': 'cba935b8-e55f-4621-9560-a6c814db93c1', 'serial': 'cba935b8-e55f-4621-9560-a6c814db93c1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:40:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:40:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:40:15 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:40:15 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:40:15 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25ee9d4-8b2a-439d-b364-3d55c34217fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:40:15 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1abd61-3d43-4128-89ed-e23a15bc2f41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1] added
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb22d6a-aa19-4dcb-b62b-38288e7205d0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc998ad0-9711-46f3-97a7-809009475387]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLXPAWt {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLXPAWt" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec938394-dc98-47f6-aa4e-fee014e917e6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SeLXPAWt'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35447b91-b84c-4929-8323-dc22826e4a1e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d935e-6020-472f-b11b-acf5df02b722]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc99c284-97be-48c5-8687-5db445f3659e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260]
Dec 06 14:40:15 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260] successful.
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7284290-9fef-4dae-81f6-e86b67d83ccc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47b53e-c3cd-4221-9767-ef2a2d464d1e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:40:15 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1547a-ea9c-4dab-b767-730c496a32ba]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:40:15 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26232336563326537', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232336563326537', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777576719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777576719',id=46,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-j2mjgyex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:40:00Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=599dcc7b-ac21-4c3a-ad14-3412d5d19365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:40:16 user nova-compute[75326]:   <uuid>599dcc7b-ac21-4c3a-ad14-3412d5d19365</uuid>
Dec 06 14:40:16 user nova-compute[75326]:   <name>instance-0000002e</name>
Dec 06 14:40:16 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:40:16 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:40:16 user nova-compute[75326]:   <metadata>
Dec 06 14:40:16 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:40:16 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-777576719</nova:name>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:40:15</nova:creationTime>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:40:16 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:40:16 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:owner>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:40:16 user nova-compute[75326]:       </nova:owner>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:40:16 user nova-compute[75326]:       <nova:ports>
Dec 06 14:40:16 user nova-compute[75326]:         <nova:port uuid="0c4885e7-2139-422c-9f3b-f33cbc5b38db">
Dec 06 14:40:16 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:40:16 user nova-compute[75326]:         </nova:port>
Dec 06 14:40:16 user nova-compute[75326]:       </nova:ports>
Dec 06 14:40:16 user nova-compute[75326]:     </nova:instance>
Dec 06 14:40:16 user nova-compute[75326]:   </metadata>
Dec 06 14:40:16 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:40:16 user nova-compute[75326]:     <system>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="serial">599dcc7b-ac21-4c3a-ad14-3412d5d19365</entry>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="uuid">599dcc7b-ac21-4c3a-ad14-3412d5d19365</entry>
Dec 06 14:40:16 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:40:16 user nova-compute[75326]:     </system>
Dec 06 14:40:16 user nova-compute[75326]:   </sysinfo>
Dec 06 14:40:16 user nova-compute[75326]:   <os>
Dec 06 14:40:16 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:40:16 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:40:16 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:40:16 user nova-compute[75326]:   </os>
Dec 06 14:40:16 user nova-compute[75326]:   <features>
Dec 06 14:40:16 user nova-compute[75326]:     <acpi/>
Dec 06 14:40:16 user nova-compute[75326]:     <apic/>
Dec 06 14:40:16 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:40:16 user nova-compute[75326]:   </features>
Dec 06 14:40:16 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:40:16 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:40:16 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:40:16 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:40:16 user nova-compute[75326]:   </clock>
Dec 06 14:40:16 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:40:16 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:40:16 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:40:16 user nova-compute[75326]:   </cpu>
Dec 06 14:40:16 user nova-compute[75326]:   <devices>
Dec 06 14:40:16 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:40:16 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:40:16 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:40:16 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:40:16 user nova-compute[75326]:       <serial>cba935b8-e55f-4621-9560-a6c814db93c1</serial>
Dec 06 14:40:16 user nova-compute[75326]:     </disk>
Dec 06 14:40:16 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:40:16 user nova-compute[75326]:       <mac address="fa:16:3e:8e:8b:b5"/>
Dec 06 14:40:16 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:40:16 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:40:16 user nova-compute[75326]:       <target dev="tap0c4885e7-21"/>
Dec 06 14:40:16 user nova-compute[75326]:     </interface>
Dec 06 14:40:16 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:40:16 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/console.log" append="off"/>
Dec 06 14:40:16 user nova-compute[75326]:     </serial>
Dec 06 14:40:16 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:40:16 user nova-compute[75326]:     <video>
Dec 06 14:40:16 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:40:16 user nova-compute[75326]:     </video>
Dec 06 14:40:16 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:40:16 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:40:16 user nova-compute[75326]:     </rng>
Dec 06 14:40:16 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:40:16 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:40:16 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:40:16 user nova-compute[75326]:     </memballoon>
Dec 06 14:40:16 user nova-compute[75326]:   </devices>
Dec 06 14:40:16 user nova-compute[75326]: </domain>
Dec 06 14:40:16 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777576719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777576719',id=46,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-j2mjgyex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:40:00Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=599dcc7b-ac21-4c3a-ad14-3412d5d19365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG os_vif [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '712a320a-4ac3-53ae-bf9c-facd96bb3c59', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c4885e7-21, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c4885e7-21, col_values=(('qos', UUID('7b46936b-51db-4b25-8615-72a707117382')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c4885e7-21, col_values=(('external_ids', {'iface-id': '0c4885e7-2139-422c-9f3b-f33cbc5b38db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:8b:b5', 'vm-uuid': '599dcc7b-ac21-4c3a-ad14-3412d5d19365'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:16 user nova-compute[75326]: INFO os_vif [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21')
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:40:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:8e:8b:b5, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG nova.compute.manager [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:40:18 user nova-compute[75326]: WARNING nova.compute.manager [req-d8aadabd-a296-4b7d-93ba-4a1c8f0687ce req-3e795261-d458-4ced-8b24-c5e8aab4c4e4 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state building and task_state spawning.
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 is timed out.
Dec 06 14:40:19 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config.
Dec 06 14:40:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNYwmciX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:40:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e191d-820c-4832-936c-cd359618149d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:40:19 user nova-compute[75326]: No targets found.
Dec 06 14:40:19 user nova-compute[75326]: iSNS:
Dec 06 14:40:19 user nova-compute[75326]: No targets found.
Dec 06 14:40:19 user nova-compute[75326]: STATIC:
Dec 06 14:40:19 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:40:19 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:40:19 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:40:19 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7
Dec 06 14:40:19 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:40:19 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:40:19 user nova-compute[75326]: FIRMWARE:
Dec 06 14:40:19 user nova-compute[75326]: No targets found.
Dec 06 14:40:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:40:19 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:40:19 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fd3dea-a514-479c-8e75-557d563e775e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63d5d4-2218-4c53-91f1-7c2a3c10b494]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:19 user nova-compute[75326]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:40:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 (non-flash)
Dec 06 14:40:19 user nova-compute[75326]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:40:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd40f8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a4e14-9f96-4217-92e5-651bd1d12012]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39831af-0d51-4fd2-b816-46f35b256f62]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b8815-123f-4f3d-9e18-29f8fe7fdb0c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[680d3add-4d02-4e52-9bc5-910b959a4955]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[50950ee9-4469-42e6-90d3-b619c2e25aaa]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6610560-c97b-4f61-b3de-89f40167eaf1]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260]
Dec 06 14:40:19 user nova-compute[75326]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7, portal: 172.16.0.220,3260] successful.
Dec 06 14:40:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c590bd8-c28c-42d1-9ebe-1a8d86387eb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1516b87f-7e52-4ca7-9f89-b52c7dc99faf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== disconnect_volume: return (298ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:40:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:40:20 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance spawned successfully.
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:40:20 user nova-compute[75326]: INFO nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Took 5.02 seconds to spawn the instance on the hypervisor.
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f29c9b63-589e-46e9-81cf-f1915f310e24 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.913s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:20 user nova-compute[75326]: DEBUG nova.compute.manager [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:40:20 user nova-compute[75326]: WARNING nova.compute.manager [req-6a7d4416-a651-401e-95c1-36b83594cee2 req-49f87ddb-db76-4833-bdbe-25e47415d858 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state building and task_state spawning.
Dec 06 14:40:20 user nova-compute[75326]: INFO nova.compute.manager [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Took 21.00 seconds to build instance.
Dec 06 14:40:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-13e20f1c-e22c-4070-993b-59abe42e0e78 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.089s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:45 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:51 user nova-compute[75326]: INFO nova.compute.manager [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attaching volume 1fe73ea3-27bc-40eb-b394-c87a80424371 to /dev/vdb
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.utils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb847686-6b95-4a0b-9e75-fff300f1d611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb67558-2d44-450a-8f44-0a881740605a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab879759-97aa-4a07-8632-eddf07e12e67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb7090-51d0-4127-a326-436dcd861405]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:51 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:40:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fda415-217d-4bbf-8829-12c5f6eae29d]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG os_brick.utils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating existing volume attachment record: cb71cc1f-3dd7-40a8-925b-f4adb0b38d4b {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:40:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:40:57 user nova-compute[75326]: INFO nova.compute.claims [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Claim successful on node user
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:40:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.policy [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:40:57 user nova-compute[75326]: INFO nova.virt.block_device [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Booting with volume 83f85af7-e5be-40a5-a561-5af6cc616e59 at /dev/vda
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.utils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879f90e-9c19-444f-9421-6da862170c05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeaa40c-111b-463b-ae1c-2da8960770df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd2e936-8e3c-4fd2-b9b2-3e706ed4d204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9326ff2c-c3d4-427c-b9b9-c5778349f92d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:40:57 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:40:57 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564df41-e78a-4da0-9289-6c4360d48b9f]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG os_brick.utils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:40:57 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updating existing volume attachment record: a582a102-7fc3-410e-8a6d-d149bc22f321 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Successfully created port: 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Successfully updated port: 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:40:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-changed-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.compute.manager [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Refreshing instance network info cache due to event network-changed-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] Acquiring lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updating instance_info_cache with network_info: [{"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Instance network_info: |[{"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] Acquired lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.network.neutron [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Refreshing network info cache for port 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:40:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:40:59 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:40:59 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.197250366210938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:40:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 9bf928b9-039d-4421-ad41-aabfe63dac7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updated VIF entry in instance network info cache for port 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG nova.network.neutron [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updating instance_info_cache with network_info: [{"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:41:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8d3557b6-d682-49c1-a93d-3f897404b35d req-1cf70830-7f6a-4ed7-a48b-007e22ccd7ac service nova] Releasing lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:41:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkxEAmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:41:02 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:02 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:02 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c1b52-6e70-4277-851c-0231e8a8bb48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:41:02 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f5115-0984-4b09-b9cb-d29ccab59fa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371] added
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a0ce3-22e7-4283-a8cb-1419ba4b2014]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f9aa31-6b6b-49fe-b567-a9101151d7a7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkxEAmNs {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkxEAmNs" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[32008b46-0531-43de-999a-e64387f6566b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkxEAmNs'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfbc298-49a7-4650-abe0-d2a1bdd5c4ae]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159c707-e989-4548-a7fe-9d26a247798d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ffdb6c-28e9-44df-997e-94765ce8e188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260]
Dec 06 14:41:02 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260] successful.
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a411f-659c-4ac1-9914-e9d70a9df24d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[09217bf5-848c-4f25-b920-a5ef29e5911d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:02 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91c7b6-3706-44dc-b331-d0a19783c335]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:41:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkxEAmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26235356137653263', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235356137653263', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.objects.instance [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:41:03 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:41:03 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:41:03 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:41:03 user nova-compute[75326]:   <serial>1fe73ea3-27bc-40eb-b394-c87a80424371</serial>
Dec 06 14:41:03 user nova-compute[75326]: </disk>
Dec 06 14:41:03 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No VIF found with MAC fa:16:3e:ea:20:65, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:41:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-91f9c69d-6284-4a23-8cd9-bb4612207f70 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.185s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:06 user nova-compute[75326]: INFO nova.compute.manager [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Detaching volume 1fe73ea3-27bc-40eb-b394-c87a80424371
Dec 06 14:41:06 user nova-compute[75326]: INFO nova.virt.block_device [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attempting to driver detach volume 1fe73ea3-27bc-40eb-b394-c87a80424371 from mountpoint /dev/vdb
Dec 06 14:41:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Attempting to detach device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:41:06 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:41:06 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:41:06 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:41:06 user nova-compute[75326]:   <serial>1fe73ea3-27bc-40eb-b394-c87a80424371</serial>
Dec 06 14:41:06 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:41:06 user nova-compute[75326]: </disk>
Dec 06 14:41:06 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:41:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config.
Dec 06 14:41:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:41:06 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:41:06 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:41:06 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:41:06 user nova-compute[75326]:   <serial>1fe73ea3-27bc-40eb-b394-c87a80424371</serial>
Dec 06 14:41:06 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:41:06 user nova-compute[75326]: </disk>
Dec 06 14:41:06 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:41:07 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Creating image(s)
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Ensure instance console log exists: /opt/stack/data/nova/instances/9bf928b9-039d-4421-ad41-aabfe63dac7b/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Start _get_guest_xml network_info=[{"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a582a102-7fc3-410e-8a6d-d149bc22f321', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bf928b9-039d-4421-ad41-aabfe63dac7b', 'attached_at': '', 'detached_at': '', 'volume_id': '83f85af7-e5be-40a5-a561-5af6cc616e59', 'serial': '83f85af7-e5be-40a5-a561-5af6cc616e59'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:41:07 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:41:07 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:41:07 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:07 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:07 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:07 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:41:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94117da-4068-452b-a004-5bbc4c878645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:41:08 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f884785-38b9-48a1-a64d-ee33950407d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59] added
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b2250-5c04-4793-be40-df345edf30af]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a564eb4-c28b-4609-a684-ac67eaabe5ba]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAXxQlen {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAXxQlen" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32810d8-71e3-483e-adf4-309b20745b77]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jAXxQlen'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda31b1-ad8c-498f-a0a5-5edadfd7bc72]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[414090e1-e06e-4a3c-8f05-ed3edb61de2f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2a5361-d4bc-4439-a540-7a4703d6898c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]
Dec 06 14:41:08 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0533fb5c-6b12-4319-b12a-71c062d79aa0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc722430-5987-4562-a2c9-d80df5184fb4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:08 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced46013-613f-4877-a222-eb0754785e7c]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:41:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26630626130626662', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630626130626662', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290362195',display_name='tempest-TestVolumeBootPattern-server-290362195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290362195',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-36jxrz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:40:58Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=9bf928b9-039d-4421-ad41-aabfe63dac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.objects.instance [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf928b9-039d-4421-ad41-aabfe63dac7b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:41:09 user nova-compute[75326]:   <uuid>9bf928b9-039d-4421-ad41-aabfe63dac7b</uuid>
Dec 06 14:41:09 user nova-compute[75326]:   <name>instance-0000002f</name>
Dec 06 14:41:09 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:41:09 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:41:09 user nova-compute[75326]:   <metadata>
Dec 06 14:41:09 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:41:09 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:41:09 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-server-290362195</nova:name>
Dec 06 14:41:09 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:41:07</nova:creationTime>
Dec 06 14:41:09 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:41:09 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:41:09 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:41:09 user nova-compute[75326]:       <nova:owner>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:41:09 user nova-compute[75326]:       </nova:owner>
Dec 06 14:41:09 user nova-compute[75326]:       <nova:ports>
Dec 06 14:41:09 user nova-compute[75326]:         <nova:port uuid="4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b">
Dec 06 14:41:09 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 14:41:09 user nova-compute[75326]:         </nova:port>
Dec 06 14:41:09 user nova-compute[75326]:       </nova:ports>
Dec 06 14:41:09 user nova-compute[75326]:     </nova:instance>
Dec 06 14:41:09 user nova-compute[75326]:   </metadata>
Dec 06 14:41:09 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:41:09 user nova-compute[75326]:     <system>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="serial">9bf928b9-039d-4421-ad41-aabfe63dac7b</entry>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="uuid">9bf928b9-039d-4421-ad41-aabfe63dac7b</entry>
Dec 06 14:41:09 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:41:09 user nova-compute[75326]:     </system>
Dec 06 14:41:09 user nova-compute[75326]:   </sysinfo>
Dec 06 14:41:09 user nova-compute[75326]:   <os>
Dec 06 14:41:09 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:41:09 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:41:09 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:41:09 user nova-compute[75326]:   </os>
Dec 06 14:41:09 user nova-compute[75326]:   <features>
Dec 06 14:41:09 user nova-compute[75326]:     <acpi/>
Dec 06 14:41:09 user nova-compute[75326]:     <apic/>
Dec 06 14:41:09 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:41:09 user nova-compute[75326]:   </features>
Dec 06 14:41:09 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:41:09 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:41:09 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:41:09 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:41:09 user nova-compute[75326]:   </clock>
Dec 06 14:41:09 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:41:09 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:41:09 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:41:09 user nova-compute[75326]:   </cpu>
Dec 06 14:41:09 user nova-compute[75326]:   <devices>
Dec 06 14:41:09 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:41:09 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:41:09 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:41:09 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:41:09 user nova-compute[75326]:       <serial>83f85af7-e5be-40a5-a561-5af6cc616e59</serial>
Dec 06 14:41:09 user nova-compute[75326]:     </disk>
Dec 06 14:41:09 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:41:09 user nova-compute[75326]:       <mac address="fa:16:3e:a9:92:a0"/>
Dec 06 14:41:09 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:41:09 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:41:09 user nova-compute[75326]:       <target dev="tap4ee08fa2-82"/>
Dec 06 14:41:09 user nova-compute[75326]:     </interface>
Dec 06 14:41:09 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:41:09 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/9bf928b9-039d-4421-ad41-aabfe63dac7b/console.log" append="off"/>
Dec 06 14:41:09 user nova-compute[75326]:     </serial>
Dec 06 14:41:09 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:41:09 user nova-compute[75326]:     <video>
Dec 06 14:41:09 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:41:09 user nova-compute[75326]:     </video>
Dec 06 14:41:09 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:41:09 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:41:09 user nova-compute[75326]:     </rng>
Dec 06 14:41:09 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:41:09 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:41:09 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:41:09 user nova-compute[75326]:     </memballoon>
Dec 06 14:41:09 user nova-compute[75326]:   </devices>
Dec 06 14:41:09 user nova-compute[75326]: </domain>
Dec 06 14:41:09 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290362195',display_name='tempest-TestVolumeBootPattern-server-290362195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290362195',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-36jxrz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:40:58Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=9bf928b9-039d-4421-ad41-aabfe63dac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG os_vif [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '574444d7-fe1a-5352-8c0f-df034431ceba', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee08fa2-82, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ee08fa2-82, col_values=(('qos', UUID('2e7dd53f-169d-44be-ab94-af5aaadb903f')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ee08fa2-82, col_values=(('external_ids', {'iface-id': '4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:92:a0', 'vm-uuid': '9bf928b9-039d-4421-ad41-aabfe63dac7b'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:09 user nova-compute[75326]: INFO os_vif [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82')
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:41:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:a9:92:a0, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:10 user nova-compute[75326]: DEBUG nova.compute.manager [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] No waiting events found dispatching network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:10 user nova-compute[75326]: WARNING nova.compute.manager [req-52e32f61-5e18-4507-a1e6-3e259985a7ae req-37ae1f3c-8bcf-48cc-b419-3070946ed957 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received unexpected event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b for instance with vm_state building and task_state spawning.
Dec 06 14:41:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:41:12 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Instance spawned successfully.
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:41:12 user nova-compute[75326]: INFO nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Took 5.01 seconds to spawn the instance on the hypervisor.
Dec 06 14:41:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:41:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:13 user nova-compute[75326]: DEBUG nova.compute.manager [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] No waiting events found dispatching network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:13 user nova-compute[75326]: WARNING nova.compute.manager [req-55d47bec-bd49-4bd4-a6d0-811fb7e7deda req-bb548362-3822-4272-8b6e-f2a3b718b11b service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received unexpected event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b for instance with vm_state building and task_state spawning.
Dec 06 14:41:13 user nova-compute[75326]: INFO nova.compute.manager [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Took 16.17 seconds to build instance.
Dec 06 14:41:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-f1c14e55-dfdd-4559-b72c-f8a9d778c69f tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.261s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 is timed out.
Dec 06 14:41:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config.
Dec 06 14:41:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkxEAmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:41:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f457b5-c702-48b7-93de-5dfebd956722]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:41:26 user nova-compute[75326]: No targets found.
Dec 06 14:41:26 user nova-compute[75326]: iSNS:
Dec 06 14:41:26 user nova-compute[75326]: No targets found.
Dec 06 14:41:26 user nova-compute[75326]: STATIC:
Dec 06 14:41:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:41:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:41:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:41:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59
Dec 06 14:41:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:41:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:41:26 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371
Dec 06 14:41:26 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:41:26 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:41:26 user nova-compute[75326]: FIRMWARE:
Dec 06 14:41:26 user nova-compute[75326]: No targets found.
Dec 06 14:41:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:41:26 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:41:26 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f0d71b-de65-4739-9369-03a2066dc539]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34cfb4e-969a-4bd9-9b6e-3c95fa9b2054]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44bc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:41:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a23903-b42a-4468-8d25-546e1daa63c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62198a-de0e-47b5-b190-04cfde532d14]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3945c858-76f1-4725-9e88-f7e106e15e31]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ad461-e3d2-42d8-9a2a-9229294a1462]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94509f-4150-4d73-b98d-97fed5a9f856]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[36491fb1-a474-4fee-a185-b67ffdee1511]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260]
Dec 06 14:41:27 user nova-compute[75326]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371, portal: 172.16.0.220,3260] successful.
Dec 06 14:41:27 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe73ea3-27bc-40eb-b394-c87a80424371 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00cfc3-1980-4ad3-9076-9f14f5038b14]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== disconnect_volume: return (294ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:41:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:41:28 user nova-compute[75326]: DEBUG nova.objects.instance [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-670736e8-cf24-4897-97fa-c2d99d6c77f2 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:41:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:50 user nova-compute[75326]: INFO nova.compute.manager [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Rescuing
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG nova.network.neutron [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:50 user nova-compute[75326]: WARNING nova.compute.manager [req-cfd41717-845b-49e2-b705-3cc9ed69ba10 req-4ceec8a2-b896-4322-a1e2-4790d4d686dd service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance destroyed successfully.
Dec 06 14:41:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Attempting a stable device rescue
Dec 06 14:41:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:41:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Creating image(s)
Dec 06 14:41:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'trusted_certs' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "5b26165b78af65b65b9e274554d1b2d05facb991" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "5b26165b78af65b65b9e274554d1b2d05facb991" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG nova.virt.images [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] be3dc5bf-4ab0-481b-8532-ced12e7d37ad was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:41:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.part /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.compute.manager [req-80ca9a17-0529-41f7-8c0a-d41e88c4b244 req-33b59895-16a6-480c-ad86-3398fb5c766c service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.part /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.converted" returned: 0 in 0.494s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "5b26165b78af65b65b9e274554d1b2d05facb991" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.886s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "5b26165b78af65b65b9e274554d1b2d05facb991" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "5b26165b78af65b65b9e274554d1b2d05facb991" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991 --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991,backing_fmt=raw /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991,backing_fmt=raw /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue" returned: 0 in 0.052s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "5b26165b78af65b65b9e274554d1b2d05facb991" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'migration_context' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<599dcc7b-ac21-4c3a-ad14-3412d5d19365> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start _get_guest_xml network_info=[{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:8e:8b:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'be3dc5bf-4ab0-481b-8532-ced12e7d37ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '34b8f41d-f406-4bb5-a0c1-26a91da9b73e', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '599dcc7b-ac21-4c3a-ad14-3412d5d19365', 'attached_at': '', 'detached_at': '', 'volume_id': 'cba935b8-e55f-4621-9560-a6c814db93c1', 'serial': 'cba935b8-e55f-4621-9560-a6c814db93c1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<599dcc7b-ac21-4c3a-ad14-3412d5d19365> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'numa_topology' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<599dcc7b-ac21-4c3a-ad14-3412d5d19365> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:41:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'vcpu_model' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<599dcc7b-ac21-4c3a-ad14-3412d5d19365> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:41:53 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badd769-5d3d-4816-aab2-4b8d21b6b4b4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = SeLXPAWt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 14:41:53 user nova-compute[75326]: node.name = iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:41:53 user nova-compute[75326]: node.tpgt = -1
Dec 06 14:41:53 user nova-compute[75326]: node.startup = automatic
Dec 06 14:41:53 user nova-compute[75326]: node.leading_login = No
Dec 06 14:41:53 user nova-compute[75326]: iface.iscsi_ifacename = default
Dec 06 14:41:53 user nova-compute[75326]: iface.net_ifacename = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.ipaddress = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.prefix_len = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.hwaddress = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.transport_name = tcp
Dec 06 14:41:53 user nova-compute[75326]: iface.initiatorname = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.vlan_id = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.vlan_priority = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.vlan_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.iface_num = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.mtu = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.port = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.bootproto = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.subnet_mask = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.gateway = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_alt_client_id = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_dns = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_learn_iqn = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_vendor_id_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_vendor_id = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.dhcp_slp_da = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.fragmentation = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.gratuitous_arp = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.incoming_forwarding = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.tos_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.tos = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.ttl = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.delayed_ack = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.tcp_nagle = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.tcp_wsf_state = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.tcp_wsf = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.tcp_timer_scale = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.tcp_timestamp = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.redirect = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.def_task_mgmt_timeout = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.header_digest = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.data_digest = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.immediate_data = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.initial_r2t = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.data_seq_inorder = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.data_pdu_inorder = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.erl = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.max_receive_data_len = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.first_burst_len = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.max_outstanding_r2t = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.max_burst_len = 0
Dec 06 14:41:53 user nova-compute[75326]: iface.chap_auth = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.bidi_chap = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.strict_login_compliance = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.discovery_auth = <empty>
Dec 06 14:41:53 user nova-compute[75326]: iface.discovery_logout = <empty>
Dec 06 14:41:53 user nova-compute[75326]: node.discovery_address = <empty>
Dec 06 14:41:53 user nova-compute[75326]: node.discovery_port = 0
Dec 06 14:41:53 user nova-compute[75326]: node.discovery_type = static
Dec 06 14:41:53 user nova-compute[75326]: node.session.initial_cmdsn = 0
Dec 06 14:41:53 user nova-compute[75326]: node.session.initial_login_retry_max = 8
Dec 06 14:41:53 user nova-compute[75326]: node.session.xmit_thread_priority = -20
Dec 06 14:41:53 user nova-compute[75326]: node.session.cmds_max = 128
Dec 06 14:41:53 user nova-compute[75326]: node.session.queue_depth = 32
Dec 06 14:41:53 user nova-compute[75326]: node.session.nr_sessions = 1
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.authmethod = CHAP
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.username = SeLXPAWt
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.password = ***
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.username_in = <empty>
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.password_in = <empty>
Dec 06 14:41:53 user nova-compute[75326]: node.session.auth.chap_algs = MD5
Dec 06 14:41:53 user nova-compute[75326]: node.session.timeo.replacement_timeout = 120
Dec 06 14:41:53 user nova-compute[75326]: node.session.err_timeo.abort_timeout = 15
Dec 06 14:41:53 user nova-compute[75326]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 14:41:53 user nova-compute[75326]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 14:41:53 user nova-compute[75326]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.FastAbort = Yes
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.InitialR2T = No
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.ImmediateData = Yes
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.MaxConnections = 1
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 14:41:53 user nova-compute[75326]: node.session.iscsi.ERL = 0
Dec 06 14:41:53 user nova-compute[75326]: node.session.scan = manual
Dec 06 14:41:53 user nova-compute[75326]: node.session.reopen_max = 0
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].address = 172.16.0.220
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].port = 3260
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].startup = manual
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].tcp.window_size = 524288
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].tcp.type_of_service = 0
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].timeo.logout_timeout = 15
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].timeo.login_timeout = 15
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].timeo.auth_timeout = 45
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.DataDigest = None
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.IFMarker = No
Dec 06 14:41:53 user nova-compute[75326]: node.conn[0].iscsi.OFMarker = No
Dec 06 14:41:53 user nova-compute[75326]: # END RECORD
Dec 06 14:41:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ec0ff9-8718-4ae1-9493-e5ce9271367a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc622366-26f4-45ad-9757-8ecf390eb3a0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLXPAWt {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLXPAWt" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[596500c7-8961-4a9c-9016-691ca72070f7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SeLXPAWt'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05964cf-ecc3-4687-9622-7113644394ae]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa125a-210d-4073-a65d-7faa61468f6f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:53 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:41:53 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:41:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] HCTL ('33', '0', '0', 0) found on session 57 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885a232-0d94-4656-a345-db9c4e627b71]: (4, ('0 0 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching for a device in session 57 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== connect_volume: return (158ms) {'type': 'block', 'scsi_wwn': '26232336563326537', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232336563326537', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777576719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777576719',id=46,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-j2mjgyex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:40:21Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=599dcc7b-ac21-4c3a-ad14-3412d5d19365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:8e:8b:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:8e:8b:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:41:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG nova.objects.base [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<599dcc7b-ac21-4c3a-ad14-3412d5d19365> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:41:54 user nova-compute[75326]:   <uuid>599dcc7b-ac21-4c3a-ad14-3412d5d19365</uuid>
Dec 06 14:41:54 user nova-compute[75326]:   <name>instance-0000002e</name>
Dec 06 14:41:54 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:41:54 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:41:54 user nova-compute[75326]:   <metadata>
Dec 06 14:41:54 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:41:54 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-777576719</nova:name>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:41:53</nova:creationTime>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:41:54 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:41:54 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:owner>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:41:54 user nova-compute[75326]:       </nova:owner>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:41:54 user nova-compute[75326]:       <nova:ports>
Dec 06 14:41:54 user nova-compute[75326]:         <nova:port uuid="0c4885e7-2139-422c-9f3b-f33cbc5b38db">
Dec 06 14:41:54 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 14:41:54 user nova-compute[75326]:         </nova:port>
Dec 06 14:41:54 user nova-compute[75326]:       </nova:ports>
Dec 06 14:41:54 user nova-compute[75326]:     </nova:instance>
Dec 06 14:41:54 user nova-compute[75326]:   </metadata>
Dec 06 14:41:54 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:41:54 user nova-compute[75326]:     <system>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="serial">599dcc7b-ac21-4c3a-ad14-3412d5d19365</entry>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="uuid">599dcc7b-ac21-4c3a-ad14-3412d5d19365</entry>
Dec 06 14:41:54 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:41:54 user nova-compute[75326]:     </system>
Dec 06 14:41:54 user nova-compute[75326]:   </sysinfo>
Dec 06 14:41:54 user nova-compute[75326]:   <os>
Dec 06 14:41:54 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:41:54 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:41:54 user nova-compute[75326]:   </os>
Dec 06 14:41:54 user nova-compute[75326]:   <features>
Dec 06 14:41:54 user nova-compute[75326]:     <acpi/>
Dec 06 14:41:54 user nova-compute[75326]:     <apic/>
Dec 06 14:41:54 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:41:54 user nova-compute[75326]:   </features>
Dec 06 14:41:54 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:41:54 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:41:54 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:41:54 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:41:54 user nova-compute[75326]:   </clock>
Dec 06 14:41:54 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:41:54 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:41:54 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:41:54 user nova-compute[75326]:   </cpu>
Dec 06 14:41:54 user nova-compute[75326]:   <devices>
Dec 06 14:41:54 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:41:54 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:41:54 user nova-compute[75326]:       <source dev="/dev/sdb"/>
Dec 06 14:41:54 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:41:54 user nova-compute[75326]:       <serial>cba935b8-e55f-4621-9560-a6c814db93c1</serial>
Dec 06 14:41:54 user nova-compute[75326]:     </disk>
Dec 06 14:41:54 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:41:54 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:41:54 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue"/>
Dec 06 14:41:54 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:41:54 user nova-compute[75326]:       <boot order="1"/>
Dec 06 14:41:54 user nova-compute[75326]:     </disk>
Dec 06 14:41:54 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:41:54 user nova-compute[75326]:       <mac address="fa:16:3e:8e:8b:b5"/>
Dec 06 14:41:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:41:54 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:41:54 user nova-compute[75326]:       <target dev="tap0c4885e7-21"/>
Dec 06 14:41:54 user nova-compute[75326]:     </interface>
Dec 06 14:41:54 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:41:54 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/console.log" append="off"/>
Dec 06 14:41:54 user nova-compute[75326]:     </serial>
Dec 06 14:41:54 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:41:54 user nova-compute[75326]:     <video>
Dec 06 14:41:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:41:54 user nova-compute[75326]:     </video>
Dec 06 14:41:54 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:41:54 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:41:54 user nova-compute[75326]:     </rng>
Dec 06 14:41:54 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:41:54 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:41:54 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:41:54 user nova-compute[75326]:     </memballoon>
Dec 06 14:41:54 user nova-compute[75326]:   </devices>
Dec 06 14:41:54 user nova-compute[75326]: </domain>
Dec 06 14:41:54 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:41:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance destroyed successfully.
Dec 06 14:41:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:8e:8b:b5, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:55 user nova-compute[75326]: WARNING nova.compute.manager [req-3c07546e-f0f7-4ab9-b01c-675c47099585 req-4d4bf449-f268-4624-aba0-f113d52fa15e service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:41:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:41:57 user nova-compute[75326]: WARNING nova.compute.manager [req-e5e04ff9-4bc9-4a33-862d-78731acd3113 req-4d37fc6b-61b7-473c-85fd-c85f28f03735 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state rescuing.
Dec 06 14:41:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-1589bb5a-1e00-4c86-b117-d26aede7de76 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [{"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-b477da31-cfb7-48b9-a63b-cf4b6972a912" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:41:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:41:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:41:59 user nova-compute[75326]: INFO nova.compute.manager [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attaching volume 4b828b69-fdff-40ef-9dd2-48d7d9bfa345 to /dev/vdb
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.utils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c941717-1807-46a1-be25-461a44653f20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7958d-7816-4c88-945c-15b7e2f0f6f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d43ea93-ab88-45dc-a402-19e8f1b6edbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e327637-ebc8-45fc-b11b-e0fff6868887]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:42:00 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e97bf-44e7-4b58-a209-ff98781c8a9b]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG os_brick.utils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating existing volume attachment record: 85a0a383-7afc-4363-b11a-22201330dc2d {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:00 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:01 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:02 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:42:02 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=25.10015106201172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 9bf928b9-039d-4421-ad41-aabfe63dac7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:42:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVyiEfql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:42:10 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:42:10 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:42:10 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa04fd-52a2-4841-8c26-b0714351198d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:42:10 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd1dee-f9cd-4554-91b9-7fb854a5405e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345] added
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9052071e-c324-4e50-a8c6-bc1c566db76f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfaaedd-583b-4030-92bc-cf37cf4c1aed]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVyiEfql {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVyiEfql" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4530e-4dad-4551-8f49-001e7d03f8c8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVyiEfql'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe5cb79-e273-4285-aae9-8cd5c5720fc4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2434129-7c8f-4a49-bedd-12bb72aed2f0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4ba76-b555-4806-b67a-0a224c4fb64b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260]
Dec 06 14:42:10 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260] successful.
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef3401-8b7b-408e-8118-9f5bf0cb2ea4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9c115-e802-4d77-a467-7878ef4b0ae9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)
Dec 06 14:42:10 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9755daf-bd80-42c7-8b26-660b6e48d432]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:42:10 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVyiEfql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23965376262353763', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376262353763', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 14:42:11 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:42:11 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:42:11 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:42:11 user nova-compute[75326]:   <serial>4b828b69-fdff-40ef-9dd2-48d7d9bfa345</serial>
Dec 06 14:42:11 user nova-compute[75326]: </disk>
Dec 06 14:42:11 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:42:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] No VIF found with MAC fa:16:3e:ea:20:65, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:42:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9c592629-49ee-499c-8af8-b3ac3ea60d73 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.304s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:14 user nova-compute[75326]: INFO nova.compute.manager [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Detaching volume 4b828b69-fdff-40ef-9dd2-48d7d9bfa345
Dec 06 14:42:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:14 user nova-compute[75326]: INFO nova.virt.block_device [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Attempting to driver detach volume 4b828b69-fdff-40ef-9dd2-48d7d9bfa345 from mountpoint /dev/vdb
Dec 06 14:42:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Attempting to detach device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:42:14 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:42:14 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:42:14 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:42:14 user nova-compute[75326]:   <serial>4b828b69-fdff-40ef-9dd2-48d7d9bfa345</serial>
Dec 06 14:42:14 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:42:14 user nova-compute[75326]: </disk>
Dec 06 14:42:14 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:42:14 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the persistent domain config.
Dec 06 14:42:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 14:42:14 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:42:14 user nova-compute[75326]:   <source dev="/dev/sdc"/>
Dec 06 14:42:14 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 14:42:14 user nova-compute[75326]:   <serial>4b828b69-fdff-40ef-9dd2-48d7d9bfa345</serial>
Dec 06 14:42:14 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 14:42:14 user nova-compute[75326]: </disk>
Dec 06 14:42:14 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 14:42:14 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Verify base images {{(pid=75326) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75326) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Image id fe7426de-1c65-4621-9c71-22fe165b8041 yields fingerprint bf3e20e0aa9f57e606845bc0332c9e7c572c1576 {{(pid=75326) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] image fe7426de-1c65-4621-9c71-22fe165b8041 at (/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576): checking
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] image fe7426de-1c65-4621-9c71-22fe165b8041 at (/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576): image is in use {{(pid=75326) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] 4710df1b-4bf9-4448-85ae-2ef8a7797f49 is a valid instance name {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] 4710df1b-4bf9-4448-85ae-2ef8a7797f49 has a disk file {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 is backed by bf3e20e0aa9f57e606845bc0332c9e7c572c1576 {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] 599dcc7b-ac21-4c3a-ad14-3412d5d19365 is a valid instance name {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] b477da31-cfb7-48b9-a63b-cf4b6972a912 is a valid instance name {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] b477da31-cfb7-48b9-a63b-cf4b6972a912 has a disk file {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 is backed by bf3e20e0aa9f57e606845bc0332c9e7c572c1576 {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] 9bf928b9-039d-4421-ad41-aabfe63dac7b is a valid instance name {{(pid=75326) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452
Dec 06 14:42:18 user nova-compute[75326]: WARNING nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Active base files: /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Removable base files: /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991 /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7 /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04 /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6 /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452 /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b26165b78af65b65b9e274554d1b2d05facb991
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f7d3bbf6181bf303504a2c8204c0356fed85b6f7
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fcb7ce67250a9228989ed7f5d86139fcf0447f04
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1208bee14e4dd870ef8271110bd0e6be9baecb6
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4365e25d315993c46cd6bfdc8893abb226f762ae
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/76ec96802d5dc901366ed28ee341c58681ff0c8e
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1cd1be2b5b76671d13f741d5c4746b335e852452
Dec 06 14:42:18 user nova-compute[75326]: INFO nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7bcececc948018195e89a8bddff8a84c36628cdb
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Verification complete {{(pid=75326) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Verify swap images {{(pid=75326) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 06 14:42:18 user nova-compute[75326]: DEBUG nova.virt.libvirt.imagecache [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Verify ephemeral images {{(pid=75326) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 06 14:42:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:34 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 is timed out.
Dec 06 14:42:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully detached device vdb from instance b477da31-cfb7-48b9-a63b-cf4b6972a912 from the live domain config.
Dec 06 14:42:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVyiEfql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:42:34 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e31185a-b62f-43fa-8dcc-a77aaa920668]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:42:34 user nova-compute[75326]: No targets found.
Dec 06 14:42:34 user nova-compute[75326]: iSNS:
Dec 06 14:42:34 user nova-compute[75326]: No targets found.
Dec 06 14:42:34 user nova-compute[75326]: STATIC:
Dec 06 14:42:34 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:42:34 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:42:34 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:42:34 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59
Dec 06 14:42:34 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:42:34 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:42:34 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345
Dec 06 14:42:34 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:42:34 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:42:34 user nova-compute[75326]: FIRMWARE:
Dec 06 14:42:34 user nova-compute[75326]: No targets found.
Dec 06 14:42:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:42:34 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:42:34 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee917c9-94db-4028-831c-4f49301ff4a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[058bd7ab-a6c7-42d0-a520-4f921583f18c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 (non-flash)
Dec 06 14:42:34 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4231ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eb134b-d920-4275-b215-626140c95a07]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1731d3b-3b50-4741-8668-1d10adaae039]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:42:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d56f8f-8c40-482c-a159-414af950d9eb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3203af98-4d07-4f5a-95d0-57d1a286257c]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2292ae39-5592-4d37-8a87-a32ddafae060]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7050ba-c3af-4a17-902f-f88cbd0d484d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260]
Dec 06 14:42:35 user nova-compute[75326]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345, portal: 172.16.0.220,3260] successful.
Dec 06 14:42:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b828b69-fdff-40ef-9dd2-48d7d9bfa345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c205585-fba0-4ea0-bbd7-b3c8b1d81fc7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] <== disconnect_volume: return (300ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:42:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'flavor' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:42:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-873b1719-cd14-437c-b083-6a002b073f1e tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:42:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:47 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-changed-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Refreshing instance network info cache due to event network-changed-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] Acquiring lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] Acquired lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Refreshing network info cache for port 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updated VIF entry in instance network info cache for port 4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG nova.network.neutron [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updating instance_info_cache with network_info: [{"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:42:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f80a9c7d-904b-461b-a56b-9a945654053e req-0e1c7e2d-1f3d-40dc-863b-3abe4fc95a46 service nova] Releasing lock "refresh_cache-9bf928b9-039d-4421-ad41-aabfe63dac7b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:50 user nova-compute[75326]: INFO nova.compute.manager [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Terminating instance
Dec 06 14:42:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-unplugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] No waiting events found dispatching network-vif-unplugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:42:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-7cf53636-36f8-4b2e-8675-a155a012dcf9 req-db9e13e9-966c-4a61-9782-6827c028aafb service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-unplugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:42:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Instance destroyed successfully.
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid 9bf928b9-039d-4421-ad41-aabfe63dac7b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290362195',display_name='tempest-TestVolumeBootPattern-server-290362195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290362195',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-36jxrz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:41:13Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=9bf928b9-039d-4421-ad41-aabfe63dac7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "address": "fa:16:3e:a9:92:a0", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee08fa2-82", "ovs_interfaceid": "4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_vif [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee08fa2-82, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7dd53f-169d-44be-ab94-af5aaadb903f) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:42:51 user nova-compute[75326]: INFO os_vif [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:92:a0,bridge_name='br-int',has_traffic_filtering=True,id=4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee08fa2-82')
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:42:51 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6667ac8f-0c87-4a6e-b2a1-39ffc27fe1e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:42:51 user nova-compute[75326]: No targets found.
Dec 06 14:42:51 user nova-compute[75326]: iSNS:
Dec 06 14:42:51 user nova-compute[75326]: No targets found.
Dec 06 14:42:51 user nova-compute[75326]: STATIC:
Dec 06 14:42:51 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:42:51 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:42:51 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:42:51 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59
Dec 06 14:42:51 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:42:51 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:42:51 user nova-compute[75326]: FIRMWARE:
Dec 06 14:42:51 user nova-compute[75326]: No targets found.
Dec 06 14:42:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:42:51 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:42:51 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f28b1-c63c-4ea7-bee6-bb814ab318be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d4f7a-6709-4438-9976-85d4419e6f23]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:51 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:42:51 user nova-compute[75326]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:42:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd43909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3050bb6-ff3a-4045-b57a-9c2f4f98708f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f16373-4239-4ea2-a566-b87bd464e5fd]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca4442-3659-4b12-8dc0-ee718f0c0231]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb49bbe-5e9c-427f-a7e6-6e4c84af0e70]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ef4cc6b8', '/dev/disk/by-id/scsi-26630626130626662', '/dev/disk/by-id/scsi-1SCST_BIOef4cc6b8-f0ba0bfb567d3834') {{(pid=86439) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7451c9e3-3a3f-4c29-bcf8-2fdaee997d43]: (4, None) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7643514-ec40-4d22-978a-1c173534b5bb]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f55b40-f496-4d8b-8d3f-0fae592e2bf9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]
Dec 06 14:42:51 user nova-compute[75326]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.
Dec 06 14:42:51 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f16a3-b492-480d-b6e8-6e7dcf507c5d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (280ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:42:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Deleting instance files /opt/stack/data/nova/instances/9bf928b9-039d-4421-ad41-aabfe63dac7b_del
Dec 06 14:42:51 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Deletion of /opt/stack/data/nova/instances/9bf928b9-039d-4421-ad41-aabfe63dac7b_del complete
Dec 06 14:42:51 user nova-compute[75326]: INFO nova.compute.manager [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 06 14:42:51 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:42:51 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:42:52 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Took 0.78 seconds to deallocate network for instance.
Dec 06 14:42:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-f480a9b8-ec97-4f16-b816-583433f09932 req-f19dd1c2-f2d7-49c5-84f1-9aaa5aca1f04 service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-deleted-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] Acquiring lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:52 user nova-compute[75326]: DEBUG nova.compute.manager [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] No waiting events found dispatching network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:42:52 user nova-compute[75326]: WARNING nova.compute.manager [req-af07c8e9-2ed4-4c4b-9cd0-0eedf61fc335 req-0f44acc7-8e00-4974-9104-8d6a667fe81e service nova] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Received unexpected event network-vif-plugged-4ee08fa2-82d4-443a-bbfe-fb611d8c4a6b for instance with vm_state active and task_state deleting.
Dec 06 14:42:53 user nova-compute[75326]: INFO nova.compute.manager [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 9bf928b9-039d-4421-ad41-aabfe63dac7b] Took 0.81 seconds to detach 1 volumes for instance.
Dec 06 14:42:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:42:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:42:53 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:42:53 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:42:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:53 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance 9bf928b9-039d-4421-ad41-aabfe63dac7b
Dec 06 14:42:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0b5847f3-d0fd-48d8-a0ad-2f40599d2ca6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "9bf928b9-039d-4421-ad41-aabfe63dac7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:42:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:55 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:42:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:42:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:42:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:42:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:42:58 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:42:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:42:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:42:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:42:59 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:42:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:43:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:04 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:43:04 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.08984375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance b477da31-cfb7-48b9-a63b-cf4b6972a912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:43:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:43:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:43:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:35 user nova-compute[75326]: INFO nova.compute.manager [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Terminating instance
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-unplugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] No waiting events found dispatching network-vif-unplugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-ef1a4d1e-7c32-4920-b69d-53b02987f89e req-e87ca0ba-b803-457c-a9ad-04ea5edd5709 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-unplugged-20675670-975e-4679-a503-1fd893b7fe7e for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:43:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Instance destroyed successfully.
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lazy-loading 'resources' on Instance uuid b477da31-cfb7-48b9-a63b-cf4b6972a912 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1962856366',display_name='tempest-SnapshotDataIntegrityTests-server-1962856366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1962856366',id=43,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM33j0+jzE8+KOqzyFYMT2/AClOHXeL4TQp8qUKYTL95pUsP2QaHPQ20+oVLoheEGkTB6kbkpz9Rnx7n7J+nk7GtGDKSBiRdQiwdO5GZ+2kDVipsW4oeiGfVIvx5r4SPxg==',key_name='tempest-keypair-1614337769',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18d7f00b9d6458c9049d7c9ee72175a',ramdisk_id='',reservation_id='r-z77mh42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1643468329',owner_user_name='tempest-SnapshotDataIntegrityTests-1643468329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80aee212d14c46eeb135a27b6b09b51d',uuid=b477da31-cfb7-48b9-a63b-cf4b6972a912,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converting VIF {"id": "20675670-975e-4679-a503-1fd893b7fe7e", "address": "fa:16:3e:ea:20:65", "network": {"id": "f5a2de6a-9388-46a1-810b-ac86785659ca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-782031648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18d7f00b9d6458c9049d7c9ee72175a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20675670-97", "ovs_interfaceid": "20675670-975e-4679-a503-1fd893b7fe7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG os_vif [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20675670-97, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c344041d-e165-411c-a609-f7c880ba1988) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:35 user nova-compute[75326]: INFO os_vif [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:20:65,bridge_name='br-int',has_traffic_filtering=True,id=20675670-975e-4679-a503-1fd893b7fe7e,network=Network(f5a2de6a-9388-46a1-810b-ac86785659ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20675670-97')
Dec 06 14:43:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Deleting instance files /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912_del
Dec 06 14:43:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Deletion of /opt/stack/data/nova/instances/b477da31-cfb7-48b9-a63b-cf4b6972a912_del complete
Dec 06 14:43:35 user nova-compute[75326]: INFO nova.compute.manager [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 06 14:43:35 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:43:35 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:43:36 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Took 0.81 seconds to deallocate network for instance.
Dec 06 14:43:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-b3308cf6-bcef-485a-810d-788fd41b7380 req-344219f0-522f-447e-a952-08abc33fd7f8 service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-deleted-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:43:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:36 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Deleted allocations for instance b477da31-cfb7-48b9-a63b-cf4b6972a912
Dec 06 14:43:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-81301589-f3e3-4de6-b9f7-bcce60c3d1c5 tempest-SnapshotDataIntegrityTests-1643468329 tempest-SnapshotDataIntegrityTests-1643468329-project-member] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] Acquiring lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] Lock "b477da31-cfb7-48b9-a63b-cf4b6972a912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] No waiting events found dispatching network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:37 user nova-compute[75326]: WARNING nova.compute.manager [req-4da16cea-3da5-43dc-9286-bff36265fb0e req-10d012fb-75c9-47ad-a24a-16b0dee3688f service nova] [instance: b477da31-cfb7-48b9-a63b-cf4b6972a912] Received unexpected event network-vif-plugged-20675670-975e-4679-a503-1fd893b7fe7e for instance with vm_state deleted and task_state None.
Dec 06 14:43:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:41 user nova-compute[75326]: INFO nova.compute.manager [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Unrescuing
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'flavor' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG nova.compute.manager [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:41 user nova-compute[75326]: WARNING nova.compute.manager [req-b1690022-e39f-4001-b854-e1cd9228e657 req-9cd96b64-5163-4f3a-b6d9-9d5d1f20d1d6 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:43:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:43:42 user nova-compute[75326]: INFO nova.compute.claims [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Claim successful on node user
Dec 06 14:43:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance destroyed successfully.
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:43:42 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.policy [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:43:42 user nova-compute[75326]: INFO nova.virt.block_device [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Booting with volume 83f85af7-e5be-40a5-a561-5af6cc616e59 at /dev/vda
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.utils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120528f-5adc-47b4-a76c-4e457c0d2ddb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[52992f51-4329-493d-9d4d-15cb5e1f547e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9141036c-bbe8-48dc-86dd-60e70f06892d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c34b3c1-b4c3-425f-8cfa-36fb674c1776]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:43:42 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:43:42 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ecba7-876c-484a-91cf-1b33b22c8cd9]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG os_brick.utils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:43:42 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating existing volume attachment record: 699beb01-2823-4282-81f3-d989ba44f59a {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Successfully created port: e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:44 user nova-compute[75326]: WARNING nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:44 user nova-compute[75326]: WARNING nova.compute.manager [req-4cd852c2-631c-42fd-945f-1e5fcb861420 req-d870ae0d-eb2a-47ce-ae02-45ce9ad49081 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Successfully updated port: e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:43:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Instance network_info: |[{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:43:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4274530e-967b-4853-a1aa-8aa8d8c145d9 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:43:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing instance network info cache due to event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Acquiring lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Acquired lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updated VIF entry in instance network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Releasing lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:46 user nova-compute[75326]: WARNING nova.compute.manager [req-75122fd5-adf0-4854-bb76-158558be511f req-3fc229f8-d762-41be-b39f-6e9e498060c1 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state None.
Dec 06 14:43:48 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:43:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Creating image(s)
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe941ec-ee11-41e2-8411-153a1bc166d5/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Start _get_guest_xml network_info=[{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '699beb01-2823-4282-81f3-d989ba44f59a', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fe941ec-ee11-41e2-8411-153a1bc166d5', 'attached_at': '', 'detached_at': '', 'volume_id': '83f85af7-e5be-40a5-a561-5af6cc616e59', 'serial': '83f85af7-e5be-40a5-a561-5af6cc616e59'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:43:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:43:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:43:52 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:43:52 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:43:52 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc766a5e-cea4-4f80-8da1-7de5c10e8ed5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:43:52 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[650d83ba-fa37-49af-a47f-0c07239abbc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59] added
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e27e38-f9d9-4e4a-8b31-8aedb05ceac7]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2fb60e-9cfc-4094-9aba-3273d6162853]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAXxQlen {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAXxQlen" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62019ab-4138-4af7-8012-2338016ca2c4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jAXxQlen'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70418aae-0179-4a1a-94eb-272be4741733]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06587f20-426f-4506-aa93-0ef131efa211]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e11cdf-6788-49d8-bd1f-2f60b8019691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]
Dec 06 14:43:52 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce4e57-ce2f-4596-a1f7-63fab46557b0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba52e9d9-5bc3-4741-a719-3869655427b0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:43:52 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84761307-9ea1-4c0c-aec1-3593ad5cf1a5]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:43:52 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26630626130626662', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630626130626662', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1783693347',display_name='tempest-TestVolumeBootPattern-server-1783693347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1783693347',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-twhjpir3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:43:43Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=4fe941ec-ee11-41e2-8411-153a1bc166d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe941ec-ee11-41e2-8411-153a1bc166d5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:43:53 user nova-compute[75326]:   <uuid>4fe941ec-ee11-41e2-8411-153a1bc166d5</uuid>
Dec 06 14:43:53 user nova-compute[75326]:   <name>instance-00000030</name>
Dec 06 14:43:53 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:43:53 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:43:53 user nova-compute[75326]:   <metadata>
Dec 06 14:43:53 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:43:53 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:43:53 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-server-1783693347</nova:name>
Dec 06 14:43:53 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:43:52</nova:creationTime>
Dec 06 14:43:53 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:43:53 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:43:53 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:43:53 user nova-compute[75326]:       <nova:owner>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:43:53 user nova-compute[75326]:       </nova:owner>
Dec 06 14:43:53 user nova-compute[75326]:       <nova:ports>
Dec 06 14:43:53 user nova-compute[75326]:         <nova:port uuid="e8ef5046-19af-4f40-a51b-9c99cf2e8214">
Dec 06 14:43:53 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 14:43:53 user nova-compute[75326]:         </nova:port>
Dec 06 14:43:53 user nova-compute[75326]:       </nova:ports>
Dec 06 14:43:53 user nova-compute[75326]:     </nova:instance>
Dec 06 14:43:53 user nova-compute[75326]:   </metadata>
Dec 06 14:43:53 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:43:53 user nova-compute[75326]:     <system>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="serial">4fe941ec-ee11-41e2-8411-153a1bc166d5</entry>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="uuid">4fe941ec-ee11-41e2-8411-153a1bc166d5</entry>
Dec 06 14:43:53 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:43:53 user nova-compute[75326]:     </system>
Dec 06 14:43:53 user nova-compute[75326]:   </sysinfo>
Dec 06 14:43:53 user nova-compute[75326]:   <os>
Dec 06 14:43:53 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:43:53 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:43:53 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:43:53 user nova-compute[75326]:   </os>
Dec 06 14:43:53 user nova-compute[75326]:   <features>
Dec 06 14:43:53 user nova-compute[75326]:     <acpi/>
Dec 06 14:43:53 user nova-compute[75326]:     <apic/>
Dec 06 14:43:53 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:43:53 user nova-compute[75326]:   </features>
Dec 06 14:43:53 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:43:53 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:43:53 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:43:53 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:43:53 user nova-compute[75326]:   </clock>
Dec 06 14:43:53 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:43:53 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:43:53 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:43:53 user nova-compute[75326]:   </cpu>
Dec 06 14:43:53 user nova-compute[75326]:   <devices>
Dec 06 14:43:53 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:43:53 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:43:53 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:43:53 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:43:53 user nova-compute[75326]:       <serial>83f85af7-e5be-40a5-a561-5af6cc616e59</serial>
Dec 06 14:43:53 user nova-compute[75326]:     </disk>
Dec 06 14:43:53 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:43:53 user nova-compute[75326]:       <mac address="fa:16:3e:3f:48:52"/>
Dec 06 14:43:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:43:53 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:43:53 user nova-compute[75326]:       <target dev="tape8ef5046-19"/>
Dec 06 14:43:53 user nova-compute[75326]:     </interface>
Dec 06 14:43:53 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:43:53 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/4fe941ec-ee11-41e2-8411-153a1bc166d5/console.log" append="off"/>
Dec 06 14:43:53 user nova-compute[75326]:     </serial>
Dec 06 14:43:53 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:43:53 user nova-compute[75326]:     <video>
Dec 06 14:43:53 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:43:53 user nova-compute[75326]:     </video>
Dec 06 14:43:53 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:43:53 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:43:53 user nova-compute[75326]:     </rng>
Dec 06 14:43:53 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:43:53 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:43:53 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:43:53 user nova-compute[75326]:     </memballoon>
Dec 06 14:43:53 user nova-compute[75326]:   </devices>
Dec 06 14:43:53 user nova-compute[75326]: </domain>
Dec 06 14:43:53 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1783693347',display_name='tempest-TestVolumeBootPattern-server-1783693347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1783693347',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-twhjpir3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:43:43Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=4fe941ec-ee11-41e2-8411-153a1bc166d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG os_vif [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8444bf0-70c8-5b75-a6a3-cac90b81b0cb', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8ef5046-19, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8ef5046-19, col_values=(('qos', UUID('059a8fc6-d666-469f-9372-cbc29ff2268f')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8ef5046-19, col_values=(('external_ids', {'iface-id': 'e8ef5046-19af-4f40-a51b-9c99cf2e8214', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:48:52', 'vm-uuid': '4fe941ec-ee11-41e2-8411-153a1bc166d5'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:53 user nova-compute[75326]: INFO os_vif [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19')
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:43:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:3f:48:52, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:43:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] No waiting events found dispatching network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:55 user nova-compute[75326]: WARNING nova.compute.manager [req-d2e4b27d-72e5-46fa-bcab-ff93507f392d req-09c91203-2049-45e9-bc62-04989597a397 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received unexpected event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 for instance with vm_state building and task_state spawning.
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:56 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:43:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Instance spawned successfully.
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:43:57 user nova-compute[75326]: INFO nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Took 4.88 seconds to spawn the instance on the hypervisor.
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] No waiting events found dispatching network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:43:57 user nova-compute[75326]: WARNING nova.compute.manager [req-76271ce4-f8b2-464d-b1d0-a80395819d13 req-6a39fe70-ea51-41f3-8e30-aab5657f62ca service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received unexpected event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 for instance with vm_state building and task_state spawning.
Dec 06 14:43:57 user nova-compute[75326]: INFO nova.compute.manager [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Took 15.23 seconds to build instance.
Dec 06 14:43:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6e8a3269-a393-4c7f-9e96-0f0acc4cb91e tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.324s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:43:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:43:59 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:44:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:44:03 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:44:03 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.116615295410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:44:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:14 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:50 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:44:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:44:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:45:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:45:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:45:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:04 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:04 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.11514663696289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:45:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:45:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "94378362-ab77-494b-9237-320401b6895c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:45:33 user nova-compute[75326]: INFO nova.compute.claims [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Claim successful on node user
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:45:33 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:45:33 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:45:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.policy [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e210aa5ceae64d3988d9566f7cdc79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d50eb095a86486e878dc3b4ffc74248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:45:34 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Creating image(s)
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "/opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing instance network info cache due to event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] Acquiring lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] Acquired lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.195s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk 1073741824" returned: 0 in 0.053s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Successfully created port: 6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.205s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updated VIF entry in instance network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-c1483830-94da-4c5a-aab1-88ea1e336435 req-251f9491-fc44-4a74-97ef-553ae37c35c8 service nova] Releasing lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Cannot resize image /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Ensure instance console log exists: /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Successfully updated port: 6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-changed-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Refreshing instance network info cache due to event network-changed-6ad464dd-1060-42e2-b4a3-574adcc2b0af. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] Acquiring lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Instance network_info: |[{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] Acquired lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Refreshing network info cache for port 6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Start _get_guest_xml network_info=[{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:45:35 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:35 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2010495636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2010495636',id=49,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-rk6ruc8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:45:34Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=94378362-ab77-494b-9237-320401b6895c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 94378362-ab77-494b-9237-320401b6895c {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:45:35 user nova-compute[75326]:   <uuid>94378362-ab77-494b-9237-320401b6895c</uuid>
Dec 06 14:45:35 user nova-compute[75326]:   <name>instance-00000031</name>
Dec 06 14:45:35 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:45:35 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:45:35 user nova-compute[75326]:   <metadata>
Dec 06 14:45:35 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:45:35 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2010495636</nova:name>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:45:35</nova:creationTime>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:45:35 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:45:35 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:owner>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:45:35 user nova-compute[75326]:       </nova:owner>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:45:35 user nova-compute[75326]:       <nova:ports>
Dec 06 14:45:35 user nova-compute[75326]:         <nova:port uuid="6ad464dd-1060-42e2-b4a3-574adcc2b0af">
Dec 06 14:45:35 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:45:35 user nova-compute[75326]:         </nova:port>
Dec 06 14:45:35 user nova-compute[75326]:       </nova:ports>
Dec 06 14:45:35 user nova-compute[75326]:     </nova:instance>
Dec 06 14:45:35 user nova-compute[75326]:   </metadata>
Dec 06 14:45:35 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:45:35 user nova-compute[75326]:     <system>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="serial">94378362-ab77-494b-9237-320401b6895c</entry>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="uuid">94378362-ab77-494b-9237-320401b6895c</entry>
Dec 06 14:45:35 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:45:35 user nova-compute[75326]:     </system>
Dec 06 14:45:35 user nova-compute[75326]:   </sysinfo>
Dec 06 14:45:35 user nova-compute[75326]:   <os>
Dec 06 14:45:35 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:45:35 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:45:35 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:45:35 user nova-compute[75326]:   </os>
Dec 06 14:45:35 user nova-compute[75326]:   <features>
Dec 06 14:45:35 user nova-compute[75326]:     <acpi/>
Dec 06 14:45:35 user nova-compute[75326]:     <apic/>
Dec 06 14:45:35 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:45:35 user nova-compute[75326]:   </features>
Dec 06 14:45:35 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:45:35 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:45:35 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:45:35 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:45:35 user nova-compute[75326]:   </clock>
Dec 06 14:45:35 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:45:35 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:45:35 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:45:35 user nova-compute[75326]:   </cpu>
Dec 06 14:45:35 user nova-compute[75326]:   <devices>
Dec 06 14:45:35 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:45:35 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:45:35 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk"/>
Dec 06 14:45:35 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:45:35 user nova-compute[75326]:     </disk>
Dec 06 14:45:35 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:45:35 user nova-compute[75326]:       <mac address="fa:16:3e:1f:a3:dd"/>
Dec 06 14:45:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:45:35 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:45:35 user nova-compute[75326]:       <target dev="tap6ad464dd-10"/>
Dec 06 14:45:35 user nova-compute[75326]:     </interface>
Dec 06 14:45:35 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:45:35 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/console.log" append="off"/>
Dec 06 14:45:35 user nova-compute[75326]:     </serial>
Dec 06 14:45:35 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:45:35 user nova-compute[75326]:     <video>
Dec 06 14:45:35 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:45:35 user nova-compute[75326]:     </video>
Dec 06 14:45:35 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:45:35 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:45:35 user nova-compute[75326]:     </rng>
Dec 06 14:45:35 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:45:35 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:45:35 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:45:35 user nova-compute[75326]:     </memballoon>
Dec 06 14:45:35 user nova-compute[75326]:   </devices>
Dec 06 14:45:35 user nova-compute[75326]: </domain>
Dec 06 14:45:35 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2010495636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2010495636',id=49,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-rk6ruc8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:45:34Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=94378362-ab77-494b-9237-320401b6895c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG os_vif [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5773d3d4-d9c9-58f0-a654-37b7a840c520', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ad464dd-10, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ad464dd-10, col_values=(('qos', UUID('4b039b1e-2548-4db5-8dcc-ff8c8c7dd853')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ad464dd-10, col_values=(('external_ids', {'iface-id': '6ad464dd-1060-42e2-b4a3-574adcc2b0af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:a3:dd', 'vm-uuid': '94378362-ab77-494b-9237-320401b6895c'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:35 user nova-compute[75326]: INFO os_vif [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10')
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:1f:a3:dd, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Updated VIF entry in instance network info cache for port 6ad464dd-1060-42e2-b4a3-574adcc2b0af. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:45:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0c6011d0-e585-47bc-a2a8-add74c8a826c req-feea3a9f-e908-4efb-8562-e839c7eda76a service nova] Releasing lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] Acquiring lock "94378362-ab77-494b-9237-320401b6895c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] No waiting events found dispatching network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:45:37 user nova-compute[75326]: WARNING nova.compute.manager [req-3666be34-29d9-4183-bb16-aaacb0677faa req-c68698cb-1186-4ee2-a2e2-7cbd76718b75 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received unexpected event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af for instance with vm_state building and task_state spawning.
Dec 06 14:45:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:45:39 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 94378362-ab77-494b-9237-320401b6895c] Instance spawned successfully.
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:39 user nova-compute[75326]: INFO nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Took 5.24 seconds to spawn the instance on the hypervisor.
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] Acquiring lock "94378362-ab77-494b-9237-320401b6895c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] No waiting events found dispatching network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:45:39 user nova-compute[75326]: WARNING nova.compute.manager [req-3a2e40c1-ebb7-456f-b2d6-b6f19e7c08f3 req-f8c4dd37-445f-4016-9304-74e97e530e15 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received unexpected event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af for instance with vm_state building and task_state spawning.
Dec 06 14:45:39 user nova-compute[75326]: INFO nova.compute.manager [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Took 5.83 seconds to build instance.
Dec 06 14:45:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-9df407d2-1261-4277-a4b7-faee8f671d80 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.197s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:42 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:45:42 user nova-compute[75326]: INFO nova.compute.claims [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Claim successful on node user
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:45:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.policy [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b7c2b312114f6ca9d4485667d258a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dc9e14dea14190a9d6afd7fe48ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:45:43 user nova-compute[75326]: INFO nova.virt.block_device [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Booting with volume e9d165cf-2524-4ecd-add4-9d1371b4f705 at /dev/vda
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.utils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e799983-d62f-4671-b033-48ed468dd593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b03e2f-68d0-4f3a-8bd5-dc2b3a0bdb94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb6d661-3576-4d7a-b686-e0f7a6258ad7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fc4796-baa8-4a12-98e4-2a7c21eb316c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:45:43 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:45:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[10817c67-e343-4a61-bf4e-ed92c1aa03f1]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG os_brick.utils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating existing volume attachment record: b849ee70-c87b-459e-b461-b8962f93cdb1 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:45:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Successfully created port: 48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Successfully updated port: 48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquired lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.compute.manager [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing instance network info cache due to event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] Acquiring lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating instance_info_cache with network_info: [{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Releasing lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Instance network_info: |[{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] Acquired lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:45:44 user nova-compute[75326]: DEBUG nova.network.neutron [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:45:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updated VIF entry in instance network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:45:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating instance_info_cache with network_info: [{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:45:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-dcb88f6d-52e0-4cdf-a01e-06f31e0ce0ac req-12e2143f-2a1b-46a2-ad0a-a5c05ec285a7 service nova] Releasing lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:45:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:45:53 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Creating image(s)
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Start _get_guest_xml network_info=[{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b849ee70-c87b-459e-b461-b8962f93cdb1', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTrPqkvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9d165cf-2524-4ecd-add4-9d1371b4f705', 'serial': 'e9d165cf-2524-4ecd-add4-9d1371b4f705'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:45:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:53 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTrPqkvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:45:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:45:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:45:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:45:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:45:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:45:53 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:45:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2647362f-aeac-434d-b7af-637e5709ea02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:45:54 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[571bd227-ee68-4757-b6f3-086c48ca9ce2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705] added
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f7069-2741-4198-975b-4f33b5a1b792]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec437d2-a1e4-47d2-a65a-7bc41c59d1bc]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTrPqkvH {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTrPqkvH" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12debf4-01c8-4e5f-8f8c-2f969d1cba04]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTrPqkvH'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[16268449-2a97-4b64-b9ae-3cfc5ca69d4e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[688de5da-d3b3-4b5a-bb5f-65d25939ebe6]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af4450-bbb3-4a2b-87c9-2b5c3991356a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260]
Dec 06 14:45:54 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260] successful.
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df56d7-048a-4a25-b8d7-73aac9b87558]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfdc638-08cb-4d03-8107-3b04083a5011]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)
Dec 06 14:45:54 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] HCTL ('35', '-', '-', 0) found on session 62 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e096bd-9d63-4a71-af31-fede306a40ba]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:45:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTrPqkvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26432623936363461', 'path': '/dev/sdd'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432623936363461', 'path': '/dev/sdd'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-398123868',display_name='tempest-TestVolumeBootPattern-server-398123868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-398123868',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-m5wj0ytn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:45:43Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.objects.instance [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'pci_devices' on Instance uuid f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:45:55 user nova-compute[75326]:   <uuid>f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865</uuid>
Dec 06 14:45:55 user nova-compute[75326]:   <name>instance-00000032</name>
Dec 06 14:45:55 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:45:55 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:45:55 user nova-compute[75326]:   <metadata>
Dec 06 14:45:55 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:45:55 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:45:55 user nova-compute[75326]:       <nova:name>tempest-TestVolumeBootPattern-server-398123868</nova:name>
Dec 06 14:45:55 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:45:53</nova:creationTime>
Dec 06 14:45:55 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:45:55 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:45:55 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:45:55 user nova-compute[75326]:       <nova:owner>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:user uuid="11b7c2b312114f6ca9d4485667d258a3">tempest-TestVolumeBootPattern-582175585-project-member</nova:user>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:project uuid="06dc9e14dea14190a9d6afd7fe48ea18">tempest-TestVolumeBootPattern-582175585</nova:project>
Dec 06 14:45:55 user nova-compute[75326]:       </nova:owner>
Dec 06 14:45:55 user nova-compute[75326]:       <nova:ports>
Dec 06 14:45:55 user nova-compute[75326]:         <nova:port uuid="48bad630-f39a-440b-ba36-c773d1b61e8f">
Dec 06 14:45:55 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 14:45:55 user nova-compute[75326]:         </nova:port>
Dec 06 14:45:55 user nova-compute[75326]:       </nova:ports>
Dec 06 14:45:55 user nova-compute[75326]:     </nova:instance>
Dec 06 14:45:55 user nova-compute[75326]:   </metadata>
Dec 06 14:45:55 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:45:55 user nova-compute[75326]:     <system>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="serial">f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865</entry>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="uuid">f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865</entry>
Dec 06 14:45:55 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:45:55 user nova-compute[75326]:     </system>
Dec 06 14:45:55 user nova-compute[75326]:   </sysinfo>
Dec 06 14:45:55 user nova-compute[75326]:   <os>
Dec 06 14:45:55 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:45:55 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:45:55 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:45:55 user nova-compute[75326]:   </os>
Dec 06 14:45:55 user nova-compute[75326]:   <features>
Dec 06 14:45:55 user nova-compute[75326]:     <acpi/>
Dec 06 14:45:55 user nova-compute[75326]:     <apic/>
Dec 06 14:45:55 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:45:55 user nova-compute[75326]:   </features>
Dec 06 14:45:55 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:45:55 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:45:55 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:45:55 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:45:55 user nova-compute[75326]:   </clock>
Dec 06 14:45:55 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:45:55 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:45:55 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:45:55 user nova-compute[75326]:   </cpu>
Dec 06 14:45:55 user nova-compute[75326]:   <devices>
Dec 06 14:45:55 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:45:55 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:45:55 user nova-compute[75326]:       <source dev="/dev/sdd"/>
Dec 06 14:45:55 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:45:55 user nova-compute[75326]:       <serial>e9d165cf-2524-4ecd-add4-9d1371b4f705</serial>
Dec 06 14:45:55 user nova-compute[75326]:     </disk>
Dec 06 14:45:55 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:45:55 user nova-compute[75326]:       <mac address="fa:16:3e:b1:77:42"/>
Dec 06 14:45:55 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:45:55 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:45:55 user nova-compute[75326]:       <target dev="tap48bad630-f3"/>
Dec 06 14:45:55 user nova-compute[75326]:     </interface>
Dec 06 14:45:55 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:45:55 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865/console.log" append="off"/>
Dec 06 14:45:55 user nova-compute[75326]:     </serial>
Dec 06 14:45:55 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:45:55 user nova-compute[75326]:     <video>
Dec 06 14:45:55 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:45:55 user nova-compute[75326]:     </video>
Dec 06 14:45:55 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:45:55 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:45:55 user nova-compute[75326]:     </rng>
Dec 06 14:45:55 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:45:55 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:45:55 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:45:55 user nova-compute[75326]:     </memballoon>
Dec 06 14:45:55 user nova-compute[75326]:   </devices>
Dec 06 14:45:55 user nova-compute[75326]: </domain>
Dec 06 14:45:55 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-398123868',display_name='tempest-TestVolumeBootPattern-server-398123868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-398123868',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-m5wj0ytn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:45:43Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG os_vif [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3f3e340-90cb-50ab-841d-84bd6f94cea2', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48bad630-f3, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48bad630-f3, col_values=(('qos', UUID('593995dc-99d0-4d8e-bd24-84fc3b28ca00')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48bad630-f3, col_values=(('external_ids', {'iface-id': '48bad630-f39a-440b-ba36-c773d1b61e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:77:42', 'vm-uuid': 'f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:55 user nova-compute[75326]: INFO os_vif [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3')
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:45:55 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] No VIF found with MAC fa:16:3e:b1:77:42, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:45:56 user nova-compute[75326]: WARNING nova.compute.manager [req-fb2d0830-5997-4097-a8e2-efe0e6fd22f3 req-6d1b0e88-d321-4361-b599-7000a0808c1b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state building and task_state spawning.
Dec 06 14:45:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:45:58 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Instance spawned successfully.
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:45:58 user nova-compute[75326]: INFO nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Took 4.88 seconds to spawn the instance on the hypervisor.
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:45:58 user nova-compute[75326]: WARNING nova.compute.manager [req-76a78386-4865-43fa-92b6-f92fc244e82a req-6b47ca13-3f60-45cf-8402-4b390698335d service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state building and task_state spawning.
Dec 06 14:45:58 user nova-compute[75326]: INFO nova.compute.manager [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Took 16.17 seconds to build instance.
Dec 06 14:45:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-7d3c4c10-a5f0-4b7a-a0c6-6f779ba53284 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.275s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:45:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:46:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:46:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:46:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.076820373535156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:46:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:46:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:46:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:46:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:46:52 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:46:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:46:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:00 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:47:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:47:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:47:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:47:02 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:47:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:47:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:47:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:04 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:47:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:47:05 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.075931549072266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:47:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:24 user nova-compute[75326]: DEBUG nova.compute.manager [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:47:24 user nova-compute[75326]: INFO nova.compute.manager [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] instance snapshotting
Dec 06 14:47:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Beginning live snapshot process
Dec 06 14:47:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:24 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json -f qcow2 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.203s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7.delta 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7.delta 1073741824" returned: 0 in 0.055s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:25 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 14:47:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:47:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75326) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 14:47:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 14:47:26 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:47:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7.delta /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7.delta /opt/stack/data/nova/instances/snapshots/tmp129bq5mq/b9be5449d9d149858afc1cf5f15322e7" returned: 0 in 0.647s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:27 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Snapshot extracted, beginning image upload
Dec 06 14:47:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Snapshot image upload complete
Dec 06 14:47:29 user nova-compute[75326]: INFO nova.compute.manager [None req-752e0639-362b-4f63-b20c-4cc3a84d4668 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Took 5.61 seconds to snapshot the instance on the hypervisor.
Dec 06 14:47:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing instance network info cache due to event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] Acquiring lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] Acquired lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updated VIF entry in instance network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating instance_info_cache with network_info: [{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:47:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-6fd1a8d1-77f1-45ef-a5cc-855dbf6cba31 req-a59007da-d706-497e-9443-dd74c146811e service nova] Releasing lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing instance network info cache due to event network-changed-48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] Acquiring lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] Acquired lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Refreshing network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:35 user nova-compute[75326]: INFO nova.compute.manager [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Terminating instance
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updated VIF entry in instance network info cache for port 48bad630-f39a-440b-ba36-c773d1b61e8f. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating instance_info_cache with network_info: [{"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5b236c80-1dfe-409e-b5b1-245ed8a5e80e req-255fe43c-8123-473a-93e4-9f144551f304 service nova] Releasing lock "refresh_cache-f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Instance destroyed successfully.
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-398123868',display_name='tempest-TestVolumeBootPattern-server-398123868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-398123868',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:45:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-m5wj0ytn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:45:59Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "48bad630-f39a-440b-ba36-c773d1b61e8f", "address": "fa:16:3e:b1:77:42", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bad630-f3", "ovs_interfaceid": "48bad630-f39a-440b-ba36-c773d1b61e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_vif [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48bad630-f3, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=593995dc-99d0-4d8e-bd24-84fc3b28ca00) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:35 user nova-compute[75326]: INFO os_vif [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:77:42,bridge_name='br-int',has_traffic_filtering=True,id=48bad630-f39a-440b-ba36-c773d1b61e8f,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bad630-f3')
Dec 06 14:47:35 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTrPqkvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:47:35 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d12d6-9e3d-49b5-89d2-7b242218d33a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:47:35 user nova-compute[75326]: No targets found.
Dec 06 14:47:35 user nova-compute[75326]: iSNS:
Dec 06 14:47:35 user nova-compute[75326]: No targets found.
Dec 06 14:47:35 user nova-compute[75326]: STATIC:
Dec 06 14:47:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:47:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:47:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:47:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705
Dec 06 14:47:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:47:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:47:35 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59
Dec 06 14:47:35 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:47:35 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:47:35 user nova-compute[75326]: FIRMWARE:
Dec 06 14:47:35 user nova-compute[75326]: No targets found.
Dec 06 14:47:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:47:35 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:47:35 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335c6cb-1f7a-47da-9034-e2c48d3a5f51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad06a7d5-7b84-4291-a62a-42058a85e2f0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:47:35 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 (non-flash)
Dec 06 14:47:35 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44ee710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705'): ({'sdd'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdd {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05e28a7-78ec-4416-9659-8e72fe17dbb6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7a2a0-f1e0-4615-87f9-b9d27829c814]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdd {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2d4e6-66f7-4f89-abc3-d96a7a8bfb8a]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088d0f2-b237-44ae-808b-33c0a7473585]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdd have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46783c-9eda-4f4d-b69d-c75af9fe8516]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f2d7b-3fb6-4063-bb6d-3661b8ccae98]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260]
Dec 06 14:47:36 user nova-compute[75326]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705, portal: 172.16.0.220,3260] successful.
Dec 06 14:47:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:36 user nova-compute[75326]: WARNING nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state active and task_state deleting.
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:36 user nova-compute[75326]: WARNING nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state active and task_state deleting.
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:36 user nova-compute[75326]: WARNING nova.compute.manager [req-288d7d5b-1aec-4e7c-946e-b98271301fdb req-05a84196-50b6-4d21-a954-19514c74055b service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state active and task_state deleting.
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d165cf-2524-4ecd-add4-9d1371b4f705 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74f97d-36d2-44a0-b1d4-8c290ad0034e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:47:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Deleting instance files /opt/stack/data/nova/instances/f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865_del
Dec 06 14:47:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Deletion of /opt/stack/data/nova/instances/f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865_del complete
Dec 06 14:47:36 user nova-compute[75326]: INFO nova.compute.manager [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Took 1.24 seconds to destroy the instance on the hypervisor.
Dec 06 14:47:36 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:47:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:37 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:47:37 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Took 0.86 seconds to deallocate network for instance.
Dec 06 14:47:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-50d09d38-e82a-4835-b2c2-c3bf6e5550a6 req-960a5ee8-70dc-4ec6-b15c-c5ef91095382 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-deleted-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:38 user nova-compute[75326]: INFO nova.compute.manager [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Took 0.82 seconds to detach 1 volumes for instance.
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:38 user nova-compute[75326]: WARNING nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-unplugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state deleted and task_state None.
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Acquiring lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] No waiting events found dispatching network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:47:38 user nova-compute[75326]: WARNING nova.compute.manager [req-efe14d87-2408-4908-9102-3a08f3ee3819 req-ce220180-befc-4a05-bfae-b8b781100359 service nova] [instance: f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865] Received unexpected event network-vif-plugged-48bad630-f39a-440b-ba36-c773d1b61e8f for instance with vm_state deleted and task_state None.
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:38 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865
Dec 06 14:47:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ebe9a621-09ed-4461-9352-f472fb4c528c tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "f0c8f3b8-8ae9-4e7c-9ddb-9dcd8b20f865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.335s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:47:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:47:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:47:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:47:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:47:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:48:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:48:06 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:48:06 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.025989532470703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:48:06 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:48:07 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:48:07 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:48:07 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:48:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:48:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:48:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:48:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:31 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:31 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:48:32 user nova-compute[75326]: INFO nova.compute.claims [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Claim successful on node user
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:48:32 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:48:32 user nova-compute[75326]: DEBUG nova.policy [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e210aa5ceae64d3988d9566f7cdc79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d50eb095a86486e878dc3b4ffc74248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:48:32 user nova-compute[75326]: INFO nova.virt.block_device [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Booting with volume-backed-image fe7426de-1c65-4621-9c71-22fe165b8041 at /dev/vda
Dec 06 14:48:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Successfully created port: c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:48:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:33 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Successfully updated port: c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-changed-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Refreshing instance network info cache due to event network-changed-c0abd85e-1efa-42d0-bec6-7e231879f67c. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] Acquiring lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating instance_info_cache with network_info: [{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance network_info: |[{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] Acquired lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Refreshing network info cache for port c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updated VIF entry in instance network info cache for port c0abd85e-1efa-42d0-bec6-7e231879f67c. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating instance_info_cache with network_info: [{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-39da81b3-6815-4698-8bbe-8857ba6849a4 req-b5c53df9-2b47-4b92-a883-062faa47dbc5 service nova] Releasing lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG nova.compute.manager [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing instance network info cache due to event network-changed-e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] Acquiring lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] Acquired lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Refreshing network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:35 user nova-compute[75326]: INFO nova.compute.manager [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Terminating instance
Dec 06 14:48:35 user nova-compute[75326]: DEBUG nova.compute.manager [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.network.neutron [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updated VIF entry in instance network info cache for port e8ef5046-19af-4f40-a51b-9c99cf2e8214. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.network.neutron [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [{"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-62ba91ba-7050-4b64-aebf-0356c5045a87 req-eccc998a-a0b4-4c6f-be9f-6bb62a00e459 service nova] Releasing lock "refresh_cache-4fe941ec-ee11-41e2-8411-153a1bc166d5" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:48:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Instance destroyed successfully.
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.objects.instance [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lazy-loading 'resources' on Instance uuid 4fe941ec-ee11-41e2-8411-153a1bc166d5 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1783693347',display_name='tempest-TestVolumeBootPattern-server-1783693347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1783693347',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjxU0smgtFn3TlpIeNiV1x7VxqtUyf6ytrVid6pn2TVYedEIhRpBjdx2dAehIZoOQdLHj+qQTQveEtLHuzffKD7OgFiInkbaoaLNqzKPFULrh3kedwTQjpwbSqosbnkQ==',key_name='tempest-TestVolumeBootPattern-1914265532',keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:43:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06dc9e14dea14190a9d6afd7fe48ea18',ramdisk_id='',reservation_id='r-twhjpir3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-582175585',owner_user_name='tempest-TestVolumeBootPattern-582175585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:43:57Z,user_data=None,user_id='11b7c2b312114f6ca9d4485667d258a3',uuid=4fe941ec-ee11-41e2-8411-153a1bc166d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converting VIF {"id": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "address": "fa:16:3e:3f:48:52", "network": {"id": "bea77a4e-5afd-43ce-95de-9ac0095f0094", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012411463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06dc9e14dea14190a9d6afd7fe48ea18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8ef5046-19", "ovs_interfaceid": "e8ef5046-19af-4f40-a51b-9c99cf2e8214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_vif [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8ef5046-19, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=059a8fc6-d666-469f-9372-cbc29ff2268f) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:36 user nova-compute[75326]: INFO os_vif [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:48:52,bridge_name='br-int',has_traffic_filtering=True,id=e8ef5046-19af-4f40-a51b-9c99cf2e8214,network=Network(bea77a4e-5afd-43ce-95de-9ac0095f0094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8ef5046-19')
Dec 06 14:48:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAXxQlen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:48:36 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc8e8f1-c759-4c8e-893d-b9b4550db8c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:48:36 user nova-compute[75326]: No targets found.
Dec 06 14:48:36 user nova-compute[75326]: iSNS:
Dec 06 14:48:36 user nova-compute[75326]: No targets found.
Dec 06 14:48:36 user nova-compute[75326]: STATIC:
Dec 06 14:48:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:48:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:48:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:48:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59
Dec 06 14:48:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:48:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:48:36 user nova-compute[75326]: FIRMWARE:
Dec 06 14:48:36 user nova-compute[75326]: No targets found.
Dec 06 14:48:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:48:36 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:48:36 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c56000-f41e-4eea-ba27-e2e7f5cee52a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1890afb6-23bd-4b99-a415-b553820bcd5f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:36 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:48:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:36 user nova-compute[75326]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 (non-flash)
Dec 06 14:48:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb42d4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72e59da-012f-44fd-8f4a-94baf73bb8c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9b615b-1676-4aad-8d04-2c994748188b]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2ee874-fb26-46c8-8cad-689fcd99c9da]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa58839-f7ea-4147-b3b3-89f9fa0ee99d]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9eff4-ab75-402a-aaf5-0bae86c003d9]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83357b5-21af-4a4f-88f0-77d7a61f78a4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260]
Dec 06 14:48:36 user nova-compute[75326]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59, portal: 172.16.0.220,3260] successful.
Dec 06 14:48:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f85af7-e5be-40a5-a561-5af6cc616e59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d68614a-5cc3-4769-a83e-35bd48c9d467]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] <== disconnect_volume: return (354ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:48:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Deleting instance files /opt/stack/data/nova/instances/4fe941ec-ee11-41e2-8411-153a1bc166d5_del
Dec 06 14:48:37 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Deletion of /opt/stack/data/nova/instances/4fe941ec-ee11-41e2-8411-153a1bc166d5_del complete
Dec 06 14:48:37 user nova-compute[75326]: INFO nova.compute.manager [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Took 1.25 seconds to destroy the instance on the hypervisor.
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:37 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Took 0.43 seconds to deallocate network for instance.
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac51d95d-b6eb-4909-b15d-69276198c9e2 req-542f9f37-980d-4ddf-a3c2-cf0f3e62b906 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-deleted-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:37 user nova-compute[75326]: INFO nova.compute.manager [req-ac51d95d-b6eb-4909-b15d-69276198c9e2 req-542f9f37-980d-4ddf-a3c2-cf0f3e62b906 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Neutron deleted interface e8ef5046-19af-4f40-a51b-9c99cf2e8214; detaching it from the instance and deleting it from the info cache
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.network.neutron [req-ac51d95d-b6eb-4909-b15d-69276198c9e2 req-542f9f37-980d-4ddf-a3c2-cf0f3e62b906 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-ac51d95d-b6eb-4909-b15d-69276198c9e2 req-542f9f37-980d-4ddf-a3c2-cf0f3e62b906 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Detach interface failed, port_id=e8ef5046-19af-4f40-a51b-9c99cf2e8214, reason: Instance 4fe941ec-ee11-41e2-8411-153a1bc166d5 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-unplugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] No waiting events found dispatching network-vif-unplugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-unplugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Acquiring lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] No waiting events found dispatching network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:48:37 user nova-compute[75326]: WARNING nova.compute.manager [req-be09e3e7-0e1b-4722-a643-92d69ba25846 req-4d9ce19e-fed8-4504-975b-bf4bab347f88 service nova] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Received unexpected event network-vif-plugged-e8ef5046-19af-4f40-a51b-9c99cf2e8214 for instance with vm_state active and task_state deleting.
Dec 06 14:48:38 user nova-compute[75326]: INFO nova.compute.manager [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] [instance: 4fe941ec-ee11-41e2-8411-153a1bc166d5] Took 0.81 seconds to detach 1 volumes for instance.
Dec 06 14:48:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:38 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:48:38 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:48:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:38 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Deleted allocations for instance 4fe941ec-ee11-41e2-8411-153a1bc166d5
Dec 06 14:48:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-ba00d6cd-4615-4f3c-a1f5-69ec7c5957a6 tempest-TestVolumeBootPattern-582175585 tempest-TestVolumeBootPattern-582175585-project-member] Lock "4fe941ec-ee11-41e2-8411-153a1bc166d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.880s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.utils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d7672-cefb-4651-8d3a-e156b436caf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f978a3-e511-44ef-bb6b-c6d2a1d9093c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bec41d-9445-45e5-8a8f-3aab9471df45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8817b3ef-36f7-41c9-a597-0e8137c59e4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 14:48:43 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 14:48:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[887492ec-61de-4134-a4f5-d7305037bd47]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG os_brick.utils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:48:43 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating existing volume attachment record: 0a5cbf86-07bb-46d7-8e2e-3bdde30015d8 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 14:48:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:48:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:48:52 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Creating image(s)
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Did not create local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Ensure instance console log exists: /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start _get_guest_xml network_info=[{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0a5cbf86-07bb-46d7-8e2e-3bdde30015d8', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67b8b34f-0963-4a8d-bd53-2f577c07c0f8', 'attached_at': '', 'detached_at': '', 'volume_id': '4c7d6b78-5a49-4380-a66d-805ab45cc235', 'serial': '4c7d6b78-5a49-4380-a66d-805ab45cc235'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:48:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:48:52 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:48:52 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:48:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:48:53 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:48:53 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a93e0e-b39c-44fc-ac0c-8cb0c62a03c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 14:48:53 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b100a-3f3e-486a-968e-434ef42aa0c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235] added
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c496981-f3dd-431e-9b3b-a2d8206e92f3]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7eb3c-955d-49a5-93fa-f565ab2c014b]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMpNSVCP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMpNSVCP" returned: 0 in 0.027s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[acba00fd-6d35-45ae-8cb4-aedd0a7e9c08]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMpNSVCP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb304b-027e-4eb2-881f-c9dd74b8b7d8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba0391-5bc1-4aee-9446-6bd0a79c2196]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bffbec-d0da-4ee2-b0b8-6dae6a7c1972]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260]
Dec 06 14:48:53 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260] successful.
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6907d2c4-1433-4e29-b7a7-072ea712919f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9755a70-4d8c-49d2-8237-5e14a5c27480]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:48:53 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67d4da-6226-4705-9e26-d0879ac5af24]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:48:53 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23262656161336333', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262656161336333', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1983454136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1983454136',id=51,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-exl5drwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:48:33Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=67b8b34f-0963-4a8d-bd53-2f577c07c0f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:48:54 user nova-compute[75326]:   <uuid>67b8b34f-0963-4a8d-bd53-2f577c07c0f8</uuid>
Dec 06 14:48:54 user nova-compute[75326]:   <name>instance-00000033</name>
Dec 06 14:48:54 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:48:54 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:48:54 user nova-compute[75326]:   <metadata>
Dec 06 14:48:54 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:48:54 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1983454136</nova:name>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:48:52</nova:creationTime>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:48:54 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:48:54 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:owner>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:48:54 user nova-compute[75326]:       </nova:owner>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:48:54 user nova-compute[75326]:       <nova:ports>
Dec 06 14:48:54 user nova-compute[75326]:         <nova:port uuid="c0abd85e-1efa-42d0-bec6-7e231879f67c">
Dec 06 14:48:54 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:48:54 user nova-compute[75326]:         </nova:port>
Dec 06 14:48:54 user nova-compute[75326]:       </nova:ports>
Dec 06 14:48:54 user nova-compute[75326]:     </nova:instance>
Dec 06 14:48:54 user nova-compute[75326]:   </metadata>
Dec 06 14:48:54 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:48:54 user nova-compute[75326]:     <system>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="serial">67b8b34f-0963-4a8d-bd53-2f577c07c0f8</entry>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="uuid">67b8b34f-0963-4a8d-bd53-2f577c07c0f8</entry>
Dec 06 14:48:54 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:48:54 user nova-compute[75326]:     </system>
Dec 06 14:48:54 user nova-compute[75326]:   </sysinfo>
Dec 06 14:48:54 user nova-compute[75326]:   <os>
Dec 06 14:48:54 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:48:54 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:48:54 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:48:54 user nova-compute[75326]:   </os>
Dec 06 14:48:54 user nova-compute[75326]:   <features>
Dec 06 14:48:54 user nova-compute[75326]:     <acpi/>
Dec 06 14:48:54 user nova-compute[75326]:     <apic/>
Dec 06 14:48:54 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:48:54 user nova-compute[75326]:   </features>
Dec 06 14:48:54 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:48:54 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:48:54 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:48:54 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:48:54 user nova-compute[75326]:   </clock>
Dec 06 14:48:54 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:48:54 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:48:54 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:48:54 user nova-compute[75326]:   </cpu>
Dec 06 14:48:54 user nova-compute[75326]:   <devices>
Dec 06 14:48:54 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:48:54 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:48:54 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:48:54 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:48:54 user nova-compute[75326]:       <serial>4c7d6b78-5a49-4380-a66d-805ab45cc235</serial>
Dec 06 14:48:54 user nova-compute[75326]:     </disk>
Dec 06 14:48:54 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:48:54 user nova-compute[75326]:       <mac address="fa:16:3e:58:97:21"/>
Dec 06 14:48:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:48:54 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:48:54 user nova-compute[75326]:       <target dev="tapc0abd85e-1e"/>
Dec 06 14:48:54 user nova-compute[75326]:     </interface>
Dec 06 14:48:54 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:48:54 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/console.log" append="off"/>
Dec 06 14:48:54 user nova-compute[75326]:     </serial>
Dec 06 14:48:54 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:48:54 user nova-compute[75326]:     <video>
Dec 06 14:48:54 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:48:54 user nova-compute[75326]:     </video>
Dec 06 14:48:54 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:48:54 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:48:54 user nova-compute[75326]:     </rng>
Dec 06 14:48:54 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:48:54 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:48:54 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:48:54 user nova-compute[75326]:     </memballoon>
Dec 06 14:48:54 user nova-compute[75326]:   </devices>
Dec 06 14:48:54 user nova-compute[75326]: </domain>
Dec 06 14:48:54 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1983454136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1983454136',id=51,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-exl5drwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:48:33Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=67b8b34f-0963-4a8d-bd53-2f577c07c0f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG os_vif [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54a7b348-6bea-5c87-8fd8-b5b8041af764', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0abd85e-1e, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0abd85e-1e, col_values=(('qos', UUID('503a7b92-fc96-45ac-af3b-b900d9468b21')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0abd85e-1e, col_values=(('external_ids', {'iface-id': 'c0abd85e-1efa-42d0-bec6-7e231879f67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:97:21', 'vm-uuid': '67b8b34f-0963-4a8d-bd53-2f577c07c0f8'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:54 user nova-compute[75326]: INFO os_vif [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e')
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:48:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:58:97:21, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:48:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:48:56 user nova-compute[75326]: WARNING nova.compute.manager [req-1e64b748-993c-4e4f-87b6-593095b555f8 req-d0197b21-2faf-47ab-9e87-1035c6eed1ca service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state building and task_state spawning.
Dec 06 14:48:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:57 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:48:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:48:57 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance spawned successfully.
Dec 06 14:48:57 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:48:58 user nova-compute[75326]: INFO nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Took 5.22 seconds to spawn the instance on the hypervisor.
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:48:58 user nova-compute[75326]: INFO nova.compute.manager [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Took 26.17 seconds to build instance.
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:48:58 user nova-compute[75326]: WARNING nova.compute.manager [req-cfbdbb72-c49d-4c48-87a8-ddea82bef6e8 req-f0e88f7a-c299-4bbd-aa76-918e7d0498f2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state None.
Dec 06 14:48:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-16b20bb1-a611-4e77-8e05-f4c323acfd61 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.267s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:48:58 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:48:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:48:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:01 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:49:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:49:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:49:07 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:49:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:49:08 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.023929595947266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:49:08 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:49:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:49:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:49:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:49:56 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:49:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:02 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:02 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:50:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:50:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:50:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:09 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:50:09 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:50:09 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.02259063720703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:50:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:50:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:22 user nova-compute[75326]: INFO nova.compute.manager [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Rescuing
Dec 06 14:50:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:50:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:50:22 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating instance_info_cache with network_info: [{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG nova.compute.manager [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:23 user nova-compute[75326]: WARNING nova.compute.manager [req-61ac507e-8096-4bb9-9c23-5aa978c7815f req-50e918d2-daec-43f7-9e78-770af8c38bb2 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance destroyed successfully.
Dec 06 14:50:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Attempting a stable device rescue
Dec 06 14:50:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75326) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance directory exists: not creating {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 14:50:24 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Creating image(s)
Dec 06 14:50:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.part --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.virt.images [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] 3aa41f2e-4789-4b47-bbb0-84e7bef5c497 was qcow2, converting to raw {{(pid=75326) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.privsep.utils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75326) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.part /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.converted {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:25 user nova-compute[75326]: WARNING nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:25 user nova-compute[75326]: WARNING nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:25 user nova-compute[75326]: WARNING nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:25 user nova-compute[75326]: WARNING nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:25 user nova-compute[75326]: WARNING nova.compute.manager [req-8e9b0050-05a9-4b44-92cd-8175d711ffe7 req-c2edfdec-04f9-4515-a2f0-07b2bf403e3d service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.part /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.converted" returned: 0 in 0.482s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.converted --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.823s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f,backing_fmt=raw /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f,backing_fmt=raw /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue" returned: 0 in 0.058s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "dfb633a3f5f863f0b1cc0e7a948b02cb5a5f2f8f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'migration_context' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<67b8b34f-0963-4a8d-bd53-2f577c07c0f8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start _get_guest_xml network_info=[{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:58:97:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aa41f2e-4789-4b47-bbb0-84e7bef5c497', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0a5cbf86-07bb-46d7-8e2e-3bdde30015d8', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '67b8b34f-0963-4a8d-bd53-2f577c07c0f8', 'attached_at': '', 'detached_at': '', 'volume_id': '4c7d6b78-5a49-4380-a66d-805ab45cc235', 'serial': '4c7d6b78-5a49-4380-a66d-805ab45cc235'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<67b8b34f-0963-4a8d-bd53-2f577c07c0f8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'numa_topology' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<67b8b34f-0963-4a8d-bd53-2f577c07c0f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:50:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:50:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<67b8b34f-0963-4a8d-bd53-2f577c07c0f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:50:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:50:26 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:50:26 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33539e3c-a08e-48f1-91fd-c8d5f41eeae8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GMpNSVCP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 14:50:26 user nova-compute[75326]: node.name = iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235
Dec 06 14:50:26 user nova-compute[75326]: node.tpgt = -1
Dec 06 14:50:26 user nova-compute[75326]: node.startup = automatic
Dec 06 14:50:26 user nova-compute[75326]: node.leading_login = No
Dec 06 14:50:26 user nova-compute[75326]: iface.iscsi_ifacename = default
Dec 06 14:50:26 user nova-compute[75326]: iface.net_ifacename = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.ipaddress = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.prefix_len = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.hwaddress = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.transport_name = tcp
Dec 06 14:50:26 user nova-compute[75326]: iface.initiatorname = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.vlan_id = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.vlan_priority = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.vlan_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.iface_num = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.mtu = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.port = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.bootproto = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.subnet_mask = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.gateway = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_alt_client_id = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_dns = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_learn_iqn = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_vendor_id_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_vendor_id = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.dhcp_slp_da = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.fragmentation = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.gratuitous_arp = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.incoming_forwarding = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.tos_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.tos = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.ttl = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.delayed_ack = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.tcp_nagle = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.tcp_wsf_state = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.tcp_wsf = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.tcp_timer_scale = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.tcp_timestamp = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.redirect = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.def_task_mgmt_timeout = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.header_digest = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.data_digest = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.immediate_data = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.initial_r2t = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.data_seq_inorder = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.data_pdu_inorder = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.erl = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.max_receive_data_len = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.first_burst_len = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.max_outstanding_r2t = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.max_burst_len = 0
Dec 06 14:50:26 user nova-compute[75326]: iface.chap_auth = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.bidi_chap = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.strict_login_compliance = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.discovery_auth = <empty>
Dec 06 14:50:26 user nova-compute[75326]: iface.discovery_logout = <empty>
Dec 06 14:50:26 user nova-compute[75326]: node.discovery_address = <empty>
Dec 06 14:50:26 user nova-compute[75326]: node.discovery_port = 0
Dec 06 14:50:26 user nova-compute[75326]: node.discovery_type = static
Dec 06 14:50:26 user nova-compute[75326]: node.session.initial_cmdsn = 0
Dec 06 14:50:26 user nova-compute[75326]: node.session.initial_login_retry_max = 8
Dec 06 14:50:26 user nova-compute[75326]: node.session.xmit_thread_priority = -20
Dec 06 14:50:26 user nova-compute[75326]: node.session.cmds_max = 128
Dec 06 14:50:26 user nova-compute[75326]: node.session.queue_depth = 32
Dec 06 14:50:26 user nova-compute[75326]: node.session.nr_sessions = 1
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.authmethod = CHAP
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.username = GMpNSVCP
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.password = ***
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.username_in = <empty>
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.password_in = <empty>
Dec 06 14:50:26 user nova-compute[75326]: node.session.auth.chap_algs = MD5
Dec 06 14:50:26 user nova-compute[75326]: node.session.timeo.replacement_timeout = 120
Dec 06 14:50:26 user nova-compute[75326]: node.session.err_timeo.abort_timeout = 15
Dec 06 14:50:26 user nova-compute[75326]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 14:50:26 user nova-compute[75326]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 14:50:26 user nova-compute[75326]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.FastAbort = Yes
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.InitialR2T = No
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.ImmediateData = Yes
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.MaxConnections = 1
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 14:50:26 user nova-compute[75326]: node.session.iscsi.ERL = 0
Dec 06 14:50:26 user nova-compute[75326]: node.session.scan = manual
Dec 06 14:50:26 user nova-compute[75326]: node.session.reopen_max = 0
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].address = 172.16.0.220
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].port = 3260
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].startup = manual
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].tcp.window_size = 524288
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].tcp.type_of_service = 0
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].timeo.logout_timeout = 15
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].timeo.login_timeout = 15
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].timeo.auth_timeout = 45
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.DataDigest = None
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.IFMarker = No
Dec 06 14:50:26 user nova-compute[75326]: node.conn[0].iscsi.OFMarker = No
Dec 06 14:50:26 user nova-compute[75326]: # END RECORD
Dec 06 14:50:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170457a-695a-4061-b3ed-8f016bcb680f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f6ce67-8fe2-410e-805c-6934e48e2b1d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMpNSVCP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMpNSVCP" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9885ae69-11b8-4d85-a31d-6d0ea39d642f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMpNSVCP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba36d9-a214-4866-aca0-7d2a6be4b85f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f894bb15-c294-4db1-9596-00d1c99b5105]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:50:26 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:50:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:50:26 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:50:26 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] HCTL ('34', '0', '0', 0) found on session 63 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.012s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f74282-fa59-4724-b858-71d292530d45]: (4, ('0 0 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Searching for a device in session 63 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23262656161336333', 'path': '/dev/sdc'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262656161336333', 'path': '/dev/sdc'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1983454136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1983454136',id=51,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:48:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-exl5drwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:48:58Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=67b8b34f-0963-4a8d-bd53-2f577c07c0f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:58:97:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "vif_mac": "fa:16:3e:58:97:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.instance [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'pci_devices' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.objects.base [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Object Instance<67b8b34f-0963-4a8d-bd53-2f577c07c0f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75326) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:50:26 user nova-compute[75326]:   <uuid>67b8b34f-0963-4a8d-bd53-2f577c07c0f8</uuid>
Dec 06 14:50:26 user nova-compute[75326]:   <name>instance-00000033</name>
Dec 06 14:50:26 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:50:26 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:50:26 user nova-compute[75326]:   <metadata>
Dec 06 14:50:26 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:50:26 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1983454136</nova:name>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:50:26</nova:creationTime>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:50:26 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:50:26 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:owner>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:user uuid="e210aa5ceae64d3988d9566f7cdc79cc">tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member</nova:user>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:project uuid="0d50eb095a86486e878dc3b4ffc74248">tempest-ServerBootFromVolumeStableRescueTest-651977033</nova:project>
Dec 06 14:50:26 user nova-compute[75326]:       </nova:owner>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:50:26 user nova-compute[75326]:       <nova:ports>
Dec 06 14:50:26 user nova-compute[75326]:         <nova:port uuid="c0abd85e-1efa-42d0-bec6-7e231879f67c">
Dec 06 14:50:26 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 14:50:26 user nova-compute[75326]:         </nova:port>
Dec 06 14:50:26 user nova-compute[75326]:       </nova:ports>
Dec 06 14:50:26 user nova-compute[75326]:     </nova:instance>
Dec 06 14:50:26 user nova-compute[75326]:   </metadata>
Dec 06 14:50:26 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:50:26 user nova-compute[75326]:     <system>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="serial">67b8b34f-0963-4a8d-bd53-2f577c07c0f8</entry>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="uuid">67b8b34f-0963-4a8d-bd53-2f577c07c0f8</entry>
Dec 06 14:50:26 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:50:26 user nova-compute[75326]:     </system>
Dec 06 14:50:26 user nova-compute[75326]:   </sysinfo>
Dec 06 14:50:26 user nova-compute[75326]:   <os>
Dec 06 14:50:26 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:50:26 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:50:26 user nova-compute[75326]:   </os>
Dec 06 14:50:26 user nova-compute[75326]:   <features>
Dec 06 14:50:26 user nova-compute[75326]:     <acpi/>
Dec 06 14:50:26 user nova-compute[75326]:     <apic/>
Dec 06 14:50:26 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:50:26 user nova-compute[75326]:   </features>
Dec 06 14:50:26 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:50:26 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:50:26 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:50:26 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:50:26 user nova-compute[75326]:   </clock>
Dec 06 14:50:26 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:50:26 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:50:26 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:50:26 user nova-compute[75326]:   </cpu>
Dec 06 14:50:26 user nova-compute[75326]:   <devices>
Dec 06 14:50:26 user nova-compute[75326]:     <disk type="block" device="disk">
Dec 06 14:50:26 user nova-compute[75326]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 14:50:26 user nova-compute[75326]:       <source dev="/dev/sdc"/>
Dec 06 14:50:26 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:50:26 user nova-compute[75326]:       <serial>4c7d6b78-5a49-4380-a66d-805ab45cc235</serial>
Dec 06 14:50:26 user nova-compute[75326]:     </disk>
Dec 06 14:50:26 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:50:26 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:50:26 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue"/>
Dec 06 14:50:26 user nova-compute[75326]:       <target dev="vdb" bus="virtio"/>
Dec 06 14:50:26 user nova-compute[75326]:       <boot order="1"/>
Dec 06 14:50:26 user nova-compute[75326]:     </disk>
Dec 06 14:50:26 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:50:26 user nova-compute[75326]:       <mac address="fa:16:3e:58:97:21"/>
Dec 06 14:50:26 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:50:26 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:50:26 user nova-compute[75326]:       <target dev="tapc0abd85e-1e"/>
Dec 06 14:50:26 user nova-compute[75326]:     </interface>
Dec 06 14:50:26 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:50:26 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/console.log" append="off"/>
Dec 06 14:50:26 user nova-compute[75326]:     </serial>
Dec 06 14:50:26 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:50:26 user nova-compute[75326]:     <video>
Dec 06 14:50:26 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:50:26 user nova-compute[75326]:     </video>
Dec 06 14:50:26 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:50:26 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:50:26 user nova-compute[75326]:     </rng>
Dec 06 14:50:26 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:50:26 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:50:26 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:50:26 user nova-compute[75326]:     </memballoon>
Dec 06 14:50:26 user nova-compute[75326]:   </devices>
Dec 06 14:50:26 user nova-compute[75326]: </domain>
Dec 06 14:50:26 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:50:26 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance destroyed successfully.
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:50:26 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] No VIF found with MAC fa:16:3e:58:97:21, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:28 user nova-compute[75326]: DEBUG nova.compute.manager [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:28 user nova-compute[75326]: WARNING nova.compute.manager [req-347a6951-96b5-40ce-a8fa-fe40ac24e7a4 req-15c44138-f806-4e60-8caa-55402efa54a3 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG nova.compute.manager [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:50:30 user nova-compute[75326]: WARNING nova.compute.manager [req-f96f0d5d-a5d4-4397-86b9-b0194df8df57 req-50e14eae-a911-44b8-94f5-ba8dd9d31a73 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state rescuing.
Dec 06 14:50:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:30 user nova-compute[75326]: DEBUG nova.compute.manager [None req-61885d4e-9750-46cd-9af8-150384f48960 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:50:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:50:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:50:57 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:50:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:00 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:51:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:06 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:08 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:51:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:51:10 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:51:10 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=24.925769805908203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:51:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:51:11 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:51:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:51:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:51:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:51:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:51:59 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:52:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:52:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:06 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:10 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:52:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:52:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:52:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=24.924945831298828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:52:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [{"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-599dcc7b-ac21-4c3a-ad14-3412d5d19365" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:52:13 user nova-compute[75326]: INFO nova.compute.manager [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Unrescuing
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquired lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:52:13 user nova-compute[75326]: DEBUG nova.network.neutron [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating instance_info_cache with network_info: [{"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Releasing lock "refresh_cache-67b8b34f-0963-4a8d-bd53-2f577c07c0f8" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'flavor' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG nova.compute.manager [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:52:14 user nova-compute[75326]: WARNING nova.compute.manager [req-de590d99-040d-4627-bc80-088ffd7fa902 req-acc42ca9-6ae0-496c-b193-297d980181bc service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:52:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:15 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance destroyed successfully.
Dec 06 14:52:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:52:16 user nova-compute[75326]: WARNING nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:52:16 user nova-compute[75326]: WARNING nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:52:16 user nova-compute[75326]: DEBUG nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:52:16 user nova-compute[75326]: WARNING nova.compute.manager [req-628410e2-273d-418d-b505-c7daba7f437e req-ef4c1ef1-5079-4dfc-9094-8f9725641887 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state rescued and task_state unrescuing.
Dec 06 14:52:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-0407c6e2-86c2-47af-a762-4ac07b350a6e tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:52:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:52:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:52:59 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:53:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:06 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:06 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:53:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:53:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:53:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:53:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=24.925125122070312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:53:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:53:13 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:53:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:53:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:53:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [{"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-94378362-ab77-494b-9237-320401b6895c" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:53:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 94378362-ab77-494b-9237-320401b6895c] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 94378362-ab77-494b-9237-320401b6895c {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "94378362-ab77-494b-9237-320401b6895c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "94378362-ab77-494b-9237-320401b6895c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "94378362-ab77-494b-9237-320401b6895c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:53:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:53:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:53:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:53:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:53:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:53:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:53:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:00 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:01 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:04 user nova-compute[75326]: INFO nova.compute.manager [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Terminating instance
Dec 06 14:54:04 user nova-compute[75326]: DEBUG nova.compute.manager [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:54:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.compute.manager [req-250f1001-ef5b-4ab3-bbf6-385c4a7ec9ed req-d04694c1-27c7-4f30-a7ec-03b260b6a6ad service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-unplugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Instance destroyed successfully.
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 67b8b34f-0963-4a8d-bd53-2f577c07c0f8 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1983454136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1983454136',id=51,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-exl5drwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:52:19Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=67b8b34f-0963-4a8d-bd53-2f577c07c0f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "address": "fa:16:3e:58:97:21", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0abd85e-1e", "ovs_interfaceid": "c0abd85e-1efa-42d0-bec6-7e231879f67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_vif [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0abd85e-1e, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=503a7b92-fc96-45ac-af3b-b900d9468b21) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:05 user nova-compute[75326]: INFO os_vif [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:97:21,bridge_name='br-int',has_traffic_filtering=True,id=c0abd85e-1efa-42d0-bec6-7e231879f67c,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0abd85e-1e')
Dec 06 14:54:05 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMpNSVCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:54:05 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fff069-ef5c-413d-9205-7a6f94ccf99e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:54:05 user nova-compute[75326]: No targets found.
Dec 06 14:54:05 user nova-compute[75326]: iSNS:
Dec 06 14:54:05 user nova-compute[75326]: No targets found.
Dec 06 14:54:05 user nova-compute[75326]: STATIC:
Dec 06 14:54:05 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:54:05 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:54:05 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:54:05 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235
Dec 06 14:54:05 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:54:05 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:54:05 user nova-compute[75326]: FIRMWARE:
Dec 06 14:54:05 user nova-compute[75326]: No targets found.
Dec 06 14:54:05 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:54:05 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:54:05 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62d570-a79e-4666-a71e-ba2df8ad660c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad9e5a-4068-4035-8dbc-9c1511312037]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:54:05 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:54:05 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:54:05 user nova-compute[75326]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 (non-flash)
Dec 06 14:54:05 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4266170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235'): ({'sdc'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Removing single pathed devices sdc {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df691e0b-8b2e-404c-9cd9-e030319ea8ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d286ce-3c14-407e-96ee-8c7c01735e62]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flushing IO for device /dev/sdc {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e30d6e-d073-4dc2-8134-683fdb527c9f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef92e43-161f-4acb-9877-d83f60707d9e]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] SCSI volumes sdc have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b406154-cdb4-4d9e-8c98-238af78fef96]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:54:05 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d63430-8257-421c-8c32-08ae5db6b16f]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260]
Dec 06 14:54:06 user nova-compute[75326]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235, portal: 172.16.0.220,3260] successful.
Dec 06 14:54:06 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7d6b78-5a49-4380-a66d-805ab45cc235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[23716db9-3858-45cd-9eee-19adff78c61e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== disconnect_volume: return (309ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:54:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Deleting instance files /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8_del
Dec 06 14:54:06 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Deletion of /opt/stack/data/nova/instances/67b8b34f-0963-4a8d-bd53-2f577c07c0f8_del complete
Dec 06 14:54:06 user nova-compute[75326]: INFO nova.compute.manager [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:06 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:54:06 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Took 0.56 seconds to deallocate network for instance.
Dec 06 14:54:06 user nova-compute[75326]: DEBUG nova.compute.manager [req-b3c65950-1d22-44b4-9048-d79b6d44271d req-65288435-e790-4b96-b997-3fe532a86835 service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-deleted-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] Acquiring lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG nova.compute.manager [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] No waiting events found dispatching network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:54:07 user nova-compute[75326]: WARNING nova.compute.manager [req-b105b7f7-ac4f-4cd8-b81d-7ecd36b9301e req-c4bf820d-bd03-4409-8bd6-2e6ff0e4788f service nova] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Received unexpected event network-vif-plugged-c0abd85e-1efa-42d0-bec6-7e231879f67c for instance with vm_state active and task_state deleting.
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:54:07 user nova-compute[75326]: INFO nova.compute.manager [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 67b8b34f-0963-4a8d-bd53-2f577c07c0f8] Took 0.98 seconds to detach 1 volumes for instance.
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:54:07 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:07 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Deleted allocations for instance 67b8b34f-0963-4a8d-bd53-2f577c07c0f8
Dec 06 14:54:08 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a712b027-fe51-4707-9b19-a2f58271d547 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "67b8b34f-0963-4a8d-bd53-2f577c07c0f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.101s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:10 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:54:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:54:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.92431640625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 94378362-ab77-494b-9237-320401b6895c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:54:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:54:14 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:54:14 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:54:14 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:54:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:54:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:54:15 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:20 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:54:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:35 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:54:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "94378362-ab77-494b-9237-320401b6895c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "94378362-ab77-494b-9237-320401b6895c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:55 user nova-compute[75326]: INFO nova.compute.manager [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Terminating instance
Dec 06 14:54:55 user nova-compute[75326]: DEBUG nova.compute.manager [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-unplugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] Acquiring lock "94378362-ab77-494b-9237-320401b6895c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] No waiting events found dispatching network-vif-unplugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-b44dfbf4-cf49-4482-8d77-7b8de8ed84c9 req-00b7610d-c7e8-4d28-af82-aad0f9a9a298 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-unplugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 94378362-ab77-494b-9237-320401b6895c] Instance destroyed successfully.
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 94378362-ab77-494b-9237-320401b6895c {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2010495636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2010495636',id=49,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-rk6ruc8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:47:30Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=94378362-ab77-494b-9237-320401b6895c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "address": "fa:16:3e:1f:a3:dd", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad464dd-10", "ovs_interfaceid": "6ad464dd-1060-42e2-b4a3-574adcc2b0af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG os_vif [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ad464dd-10, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b039b1e-2548-4db5-8dcc-ff8c8c7dd853) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:54:56 user nova-compute[75326]: INFO os_vif [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:a3:dd,bridge_name='br-int',has_traffic_filtering=True,id=6ad464dd-1060-42e2-b4a3-574adcc2b0af,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad464dd-10')
Dec 06 14:54:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Deleting instance files /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c_del
Dec 06 14:54:56 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Deletion of /opt/stack/data/nova/instances/94378362-ab77-494b-9237-320401b6895c_del complete
Dec 06 14:54:56 user nova-compute[75326]: INFO nova.compute.manager [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 94378362-ab77-494b-9237-320401b6895c] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 14:54:56 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 94378362-ab77-494b-9237-320401b6895c] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:54:56 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 94378362-ab77-494b-9237-320401b6895c] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:54:57 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 94378362-ab77-494b-9237-320401b6895c] Took 0.43 seconds to deallocate network for instance.
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-a382af96-df06-4e4d-8cdc-c51bfd92dfb0 req-aef63a11-4fcd-4918-a52b-a3064c66c994 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-deleted-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:57 user nova-compute[75326]: INFO nova.compute.manager [req-a382af96-df06-4e4d-8cdc-c51bfd92dfb0 req-aef63a11-4fcd-4918-a52b-a3064c66c994 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Neutron deleted interface 6ad464dd-1060-42e2-b4a3-574adcc2b0af; detaching it from the instance and deleting it from the info cache
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.network.neutron [req-a382af96-df06-4e4d-8cdc-c51bfd92dfb0 req-aef63a11-4fcd-4918-a52b-a3064c66c994 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.compute.manager [req-a382af96-df06-4e4d-8cdc-c51bfd92dfb0 req-aef63a11-4fcd-4918-a52b-a3064c66c994 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Detach interface failed, port_id=6ad464dd-1060-42e2-b4a3-574adcc2b0af, reason: Instance 94378362-ab77-494b-9237-320401b6895c could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:54:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:57 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Deleted allocations for instance 94378362-ab77-494b-9237-320401b6895c
Dec 06 14:54:57 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5131dae7-7e6a-4e7c-9119-86f4903d0d60 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "94378362-ab77-494b-9237-320401b6895c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:54:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] Acquiring lock "94378362-ab77-494b-9237-320401b6895c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:54:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:54:58 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] Lock "94378362-ab77-494b-9237-320401b6895c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:54:58 user nova-compute[75326]: DEBUG nova.compute.manager [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] No waiting events found dispatching network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:54:58 user nova-compute[75326]: WARNING nova.compute.manager [req-0fbfa47f-46c8-40cf-9760-90fb68fbfb47 req-76b8cb64-3886-4d58-8e78-473ab4bc4e53 service nova] [instance: 94378362-ab77-494b-9237-320401b6895c] Received unexpected event network-vif-plugged-6ad464dd-1060-42e2-b4a3-574adcc2b0af for instance with vm_state deleted and task_state None.
Dec 06 14:55:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:55:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:07 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:55:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:55:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.048904418945312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:55:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:55:14 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:55:15 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [{"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:55:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-4710df1b-4bf9-4448-85ae-2ef8a7797f49" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:55:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:55:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:55:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:55:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:46 user nova-compute[75326]: INFO nova.compute.manager [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Terminating instance
Dec 06 14:55:46 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG nova.compute.manager [req-51c4dc93-5b10-40c2-bd15-eb7286216dc9 req-a8a2e4d4-5bf1-4436-abff-6c57a6e778b5 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-unplugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Instance destroyed successfully.
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 599dcc7b-ac21-4c3a-ad14-3412d5d19365 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777576719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777576719',id=46,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-j2mjgyex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:43:46Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=599dcc7b-ac21-4c3a-ad14-3412d5d19365,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "address": "fa:16:3e:8e:8b:b5", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4885e7-21", "ovs_interfaceid": "0c4885e7-2139-422c-9f3b-f33cbc5b38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_vif [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c4885e7-21, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b46936b-51db-4b25-8615-72a707117382) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:55:47 user nova-compute[75326]: INFO os_vif [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=0c4885e7-2139-422c-9f3b-f33cbc5b38db,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4885e7-21')
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLXPAWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 14:55:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[877b86b8-9eb6-42a1-882f-22405f6203a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 14:55:47 user nova-compute[75326]: No targets found.
Dec 06 14:55:47 user nova-compute[75326]: iSNS:
Dec 06 14:55:47 user nova-compute[75326]: No targets found.
Dec 06 14:55:47 user nova-compute[75326]: STATIC:
Dec 06 14:55:47 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1
Dec 06 14:55:47 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 14:55:47 user nova-compute[75326]:                 Iface Name: default
Dec 06 14:55:47 user nova-compute[75326]: FIRMWARE:
Dec 06 14:55:47 user nova-compute[75326]: No targets found.
Dec 06 14:55:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 14:55:47 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 14:55:47 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef0b2a-afd7-4fc0-92d7-e0fce33cd0fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e27440-651d-402b-ae8e-39f5e9864b2d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:55:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 (non-flash)
Dec 06 14:55:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bd407c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f887dc5-2342-4741-ab93-9c38f88e4e21]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f759c2-e066-440e-8805-2a6ae94e7f0b]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae064ed-84a5-4998-8fca-900e3384a880]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ae7a9-62e7-4e31-9b73-e06f74d315db]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb828f-2ac0-46d0-9896-885e02720699]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a4530-b954-4c3a-a41e-6600dc71dfed]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260]
Dec 06 14:55:47 user nova-compute[75326]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1, portal: 172.16.0.220,3260] successful.
Dec 06 14:55:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cba935b8-e55f-4621-9560-a6c814db93c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[420462cd-912d-4e7b-9c27-9bb2381fe916]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] <== disconnect_volume: return (282ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 14:55:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Deleting instance files /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365_del
Dec 06 14:55:47 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Deletion of /opt/stack/data/nova/instances/599dcc7b-ac21-4c3a-ad14-3412d5d19365_del complete
Dec 06 14:55:47 user nova-compute[75326]: INFO nova.compute.manager [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 06 14:55:47 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:55:47 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:55:48 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:55:48 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Took 0.42 seconds to deallocate network for instance.
Dec 06 14:55:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:55:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] Acquiring lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:48 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] No waiting events found dispatching network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:55:48 user nova-compute[75326]: WARNING nova.compute.manager [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received unexpected event network-vif-plugged-0c4885e7-2139-422c-9f3b-f33cbc5b38db for instance with vm_state active and task_state deleting.
Dec 06 14:55:48 user nova-compute[75326]: DEBUG nova.compute.manager [req-5566df3b-b422-4f74-8fc8-ffc6f82fb66d req-3423cd7f-e601-4827-b720-866f3f8135c3 service nova] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Received event network-vif-deleted-0c4885e7-2139-422c-9f3b-f33cbc5b38db {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:55:49 user nova-compute[75326]: INFO nova.compute.manager [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 599dcc7b-ac21-4c3a-ad14-3412d5d19365] Took 1.11 seconds to detach 1 volumes for instance.
Dec 06 14:55:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:55:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:55:49 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:55:49 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:55:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:49 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Deleted allocations for instance 599dcc7b-ac21-4c3a-ad14-3412d5d19365
Dec 06 14:55:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c3d4d52-d123-4796-b27f-c35e1d6ccc20 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "599dcc7b-ac21-4c3a-ad14-3412d5d19365" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:55:52 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:55:57 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:02 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:03 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:07 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:56:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:56:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:56:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:56:13 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.04815673828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:56:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:56:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:56:17 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:22 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:56:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:32 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:37 user nova-compute[75326]: INFO nova.compute.manager [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Terminating instance
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-unplugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] No waiting events found dispatching network-vif-unplugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG nova.compute.manager [req-b28f315d-7a9f-4d6b-b23b-c36a5b94b5c6 req-95eabe49-bbdc-4f85-8b4e-3491e2dfde26 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-unplugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:56:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Instance destroyed successfully.
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lazy-loading 'resources' on Instance uuid 4710df1b-4bf9-4448-85ae-2ef8a7797f49 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1025196629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1025196629',id=44,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d50eb095a86486e878dc3b4ffc74248',ramdisk_id='',reservation_id='r-udelrh3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-651977033',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:38:57Z,user_data=None,user_id='e210aa5ceae64d3988d9566f7cdc79cc',uuid=4710df1b-4bf9-4448-85ae-2ef8a7797f49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converting VIF {"id": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "address": "fa:16:3e:8c:40:bf", "network": {"id": "fe795af7-4929-40d7-b249-6d728f69411b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-421663380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d50eb095a86486e878dc3b4ffc74248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ba6825-18", "ovs_interfaceid": "73ba6825-187e-46ca-bfd0-c27a4d742c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG os_vif [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73ba6825-18, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a4cf1ba-a9e8-4179-9c37-5166b9e437ad) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:38 user nova-compute[75326]: INFO os_vif [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:bf,bridge_name='br-int',has_traffic_filtering=True,id=73ba6825-187e-46ca-bfd0-c27a4d742c3e,network=Network(fe795af7-4929-40d7-b249-6d728f69411b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ba6825-18')
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Deleting instance files /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49_del
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Deletion of /opt/stack/data/nova/instances/4710df1b-4bf9-4448-85ae-2ef8a7797f49_del complete
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.compute.manager [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 14:56:38 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Took 0.55 seconds to deallocate network for instance.
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-061030c9-3cad-4613-ab14-294dedfed824 req-3e3941db-3f20-4021-99d9-8bae079e5171 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-deleted-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.compute.manager [req-061030c9-3cad-4613-ab14-294dedfed824 req-3e3941db-3f20-4021-99d9-8bae079e5171 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Neutron deleted interface 73ba6825-187e-46ca-bfd0-c27a4d742c3e; detaching it from the instance and deleting it from the info cache
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.network.neutron [req-061030c9-3cad-4613-ab14-294dedfed824 req-3e3941db-3f20-4021-99d9-8bae079e5171 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.compute.manager [req-061030c9-3cad-4613-ab14-294dedfed824 req-3e3941db-3f20-4021-99d9-8bae079e5171 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Detach interface failed, port_id=73ba6825-187e-46ca-bfd0-c27a4d742c3e, reason: Instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49 could not be found. {{(pid=75326) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:56:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:38 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Deleted allocations for instance 4710df1b-4bf9-4448-85ae-2ef8a7797f49
Dec 06 14:56:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-47b8f8bf-0ac6-4bd7-8b10-566876e86515 tempest-ServerBootFromVolumeStableRescueTest-651977033 tempest-ServerBootFromVolumeStableRescueTest-651977033-project-member] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:56:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] Acquiring lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:56:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:56:39 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] Lock "4710df1b-4bf9-4448-85ae-2ef8a7797f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:56:39 user nova-compute[75326]: DEBUG nova.compute.manager [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] No waiting events found dispatching network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:56:39 user nova-compute[75326]: WARNING nova.compute.manager [req-b9d45986-02a0-46dd-8422-95b714ad304a req-92603390-5b85-4f67-a2cd-387830f60af5 service nova] [instance: 4710df1b-4bf9-4448-85ae-2ef8a7797f49] Received unexpected event network-vif-plugged-73ba6825-187e-46ca-bfd0-c27a4d742c3e for instance with vm_state deleted and task_state None.
Dec 06 14:56:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:56:53 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:56:58 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:03 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:04 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:08 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:08 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:09 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:57:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:57:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:57:12 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9202MB free_disk=25.172779083251953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:57:12 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:13 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:57:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:57:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:57:18 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:57:28 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:57:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:30 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:33 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:38 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:40 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:42 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:43 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 14:57:44 user nova-compute[75326]: INFO nova.compute.claims [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Claim successful on node user
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 14:57:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.policy [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86af32db1f4a4ac1bbfe51b80f82e966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b78a1e15b244c09a501c4e3e0e62d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 14:57:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Creating image(s)
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "/opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "/opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "/opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.168s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk 1073741824" returned: 0 in 0.051s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Successfully created port: 52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.175s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Cannot resize image /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Ensure instance console log exists: /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Successfully updated port: 52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquired lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-changed-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Refreshing instance network info cache due to event network-changed-52d30188-4a4e-475c-91d8-a73124bd2be1. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] Acquiring lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updating instance_info_cache with network_info: [{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Releasing lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Instance network_info: |[{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] Acquired lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Refreshing network info cache for port 52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Start _get_guest_xml network_info=[{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 14:57:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:57:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 14:57:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539920072',display_name='tempest-VolumesActionsTest-instance-539920072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539920072',id=52,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78a1e15b244c09a501c4e3e0e62d8b',ramdisk_id='',reservation_id='r-r00sbd5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1297646649',owner_user_name='tempest-VolumesActionsTest-1297646649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:57:44Z,user_data=None,user_id='86af32db1f4a4ac1bbfe51b80f82e966',uuid=c48c0202-2e70-4ab8-940a-3a235b69a018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converting VIF {"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.objects.instance [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lazy-loading 'pci_devices' on Instance uuid c48c0202-2e70-4ab8-940a-3a235b69a018 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] End _get_guest_xml xml=<domain type="kvm">
Dec 06 14:57:46 user nova-compute[75326]:   <uuid>c48c0202-2e70-4ab8-940a-3a235b69a018</uuid>
Dec 06 14:57:46 user nova-compute[75326]:   <name>instance-00000034</name>
Dec 06 14:57:46 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 14:57:46 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 14:57:46 user nova-compute[75326]:   <metadata>
Dec 06 14:57:46 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 14:57:46 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:name>tempest-VolumesActionsTest-instance-539920072</nova:name>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:creationTime>2023-12-06 14:57:45</nova:creationTime>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 14:57:46 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 14:57:46 user nova-compute[75326]:       </nova:flavor>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:owner>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:user uuid="86af32db1f4a4ac1bbfe51b80f82e966">tempest-VolumesActionsTest-1297646649-project-member</nova:user>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:project uuid="2b78a1e15b244c09a501c4e3e0e62d8b">tempest-VolumesActionsTest-1297646649</nova:project>
Dec 06 14:57:46 user nova-compute[75326]:       </nova:owner>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 14:57:46 user nova-compute[75326]:       <nova:ports>
Dec 06 14:57:46 user nova-compute[75326]:         <nova:port uuid="52d30188-4a4e-475c-91d8-a73124bd2be1">
Dec 06 14:57:46 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 14:57:46 user nova-compute[75326]:         </nova:port>
Dec 06 14:57:46 user nova-compute[75326]:       </nova:ports>
Dec 06 14:57:46 user nova-compute[75326]:     </nova:instance>
Dec 06 14:57:46 user nova-compute[75326]:   </metadata>
Dec 06 14:57:46 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 14:57:46 user nova-compute[75326]:     <system>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="serial">c48c0202-2e70-4ab8-940a-3a235b69a018</entry>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="uuid">c48c0202-2e70-4ab8-940a-3a235b69a018</entry>
Dec 06 14:57:46 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 14:57:46 user nova-compute[75326]:     </system>
Dec 06 14:57:46 user nova-compute[75326]:   </sysinfo>
Dec 06 14:57:46 user nova-compute[75326]:   <os>
Dec 06 14:57:46 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 14:57:46 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 14:57:46 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 14:57:46 user nova-compute[75326]:   </os>
Dec 06 14:57:46 user nova-compute[75326]:   <features>
Dec 06 14:57:46 user nova-compute[75326]:     <acpi/>
Dec 06 14:57:46 user nova-compute[75326]:     <apic/>
Dec 06 14:57:46 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 14:57:46 user nova-compute[75326]:   </features>
Dec 06 14:57:46 user nova-compute[75326]:   <clock offset="utc">
Dec 06 14:57:46 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 14:57:46 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 14:57:46 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 14:57:46 user nova-compute[75326]:   </clock>
Dec 06 14:57:46 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 14:57:46 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 14:57:46 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 14:57:46 user nova-compute[75326]:   </cpu>
Dec 06 14:57:46 user nova-compute[75326]:   <devices>
Dec 06 14:57:46 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 14:57:46 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 14:57:46 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk"/>
Dec 06 14:57:46 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 14:57:46 user nova-compute[75326]:     </disk>
Dec 06 14:57:46 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 14:57:46 user nova-compute[75326]:       <mac address="fa:16:3e:ff:b0:1b"/>
Dec 06 14:57:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:57:46 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 14:57:46 user nova-compute[75326]:       <target dev="tap52d30188-4a"/>
Dec 06 14:57:46 user nova-compute[75326]:     </interface>
Dec 06 14:57:46 user nova-compute[75326]:     <serial type="pty">
Dec 06 14:57:46 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/console.log" append="off"/>
Dec 06 14:57:46 user nova-compute[75326]:     </serial>
Dec 06 14:57:46 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 14:57:46 user nova-compute[75326]:     <video>
Dec 06 14:57:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 14:57:46 user nova-compute[75326]:     </video>
Dec 06 14:57:46 user nova-compute[75326]:     <rng model="virtio">
Dec 06 14:57:46 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 14:57:46 user nova-compute[75326]:     </rng>
Dec 06 14:57:46 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 14:57:46 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 14:57:46 user nova-compute[75326]:       <stats period="10"/>
Dec 06 14:57:46 user nova-compute[75326]:     </memballoon>
Dec 06 14:57:46 user nova-compute[75326]:   </devices>
Dec 06 14:57:46 user nova-compute[75326]: </domain>
Dec 06 14:57:46 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539920072',display_name='tempest-VolumesActionsTest-instance-539920072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539920072',id=52,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78a1e15b244c09a501c4e3e0e62d8b',ramdisk_id='',reservation_id='r-r00sbd5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1297646649',owner_user_name='tempest-VolumesActionsTest-1297646649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T14:57:44Z,user_data=None,user_id='86af32db1f4a4ac1bbfe51b80f82e966',uuid=c48c0202-2e70-4ab8-940a-3a235b69a018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converting VIF {"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG os_vif [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea4fb4b5-5410-5f58-88f7-d24cb101ef92', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52d30188-4a, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52d30188-4a, col_values=(('qos', UUID('533d9386-7b79-4cf8-b42a-a360c865ed3b')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52d30188-4a, col_values=(('external_ids', {'iface-id': '52d30188-4a4e-475c-91d8-a73124bd2be1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b0:1b', 'vm-uuid': 'c48c0202-2e70-4ab8-940a-3a235b69a018'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:46 user nova-compute[75326]: INFO os_vif [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a')
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] No VIF found with MAC fa:16:3e:ff:b0:1b, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updated VIF entry in instance network info cache for port 52d30188-4a4e-475c-91d8-a73124bd2be1. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updating instance_info_cache with network_info: [{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:57:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-9e10766b-33c4-4122-a2b8-22024db2bb6d req-b2c62342-3f06-45e6-8ff2-a8e04a7abebe service nova] Releasing lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:57:47 user nova-compute[75326]: WARNING nova.compute.manager [req-4137378d-d158-436f-ab54-75f9ed367a49 req-35ffe72f-de54-4c62-bd75-01686708521e service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state building and task_state spawning.
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 14:57:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Instance spawned successfully.
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 14:57:49 user nova-compute[75326]: INFO nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Took 5.02 seconds to spawn the instance on the hypervisor.
Dec 06 14:57:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 14:57:49 user nova-compute[75326]: INFO nova.compute.manager [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Took 5.55 seconds to build instance.
Dec 06 14:57:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-eaaa750e-7736-4ebc-8249-c03fa0a7d363 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.645s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:57:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:57:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:57:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:57:50 user nova-compute[75326]: DEBUG nova.compute.manager [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:57:50 user nova-compute[75326]: WARNING nova.compute.manager [req-cf4f3b91-d963-4226-81fd-77d43d1bae56 req-2fff4617-1b8c-4cbf-8ed9-b235808ea467 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state active and task_state None.
Dec 06 14:57:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:57:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:05 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:10 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:10 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:58:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:58:14 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:58:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:58:15 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.134639739990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c48c0202-2e70-4ab8-940a-3a235b69a018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:58:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:58:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid c48c0202-2e70-4ab8-940a-3a235b69a018 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:58:17 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updating instance_info_cache with network_info: [{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:58:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:58:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:58:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:26 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 14:58:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 14:58:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:58:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 14:58:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 14:58:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:58:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:58:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:58:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:07 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:12 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 14:59:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 14:59:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 14:59:17 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:59:17 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.133888244628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance c48c0202-2e70-4ab8-940a-3a235b69a018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 14:59:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 14:59:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid c48c0202-2e70-4ab8-940a-3a235b69a018 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:59:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updating instance_info_cache with network_info: [{"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:59:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-c48c0202-2e70-4ab8-940a-3a235b69a018" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 14:59:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 14:59:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 14:59:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:45 user nova-compute[75326]: INFO nova.compute.manager [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Terminating instance
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-unplugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-unplugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-75b6fa5a-1e66-4a91-8b23-f5e015cf63e3 req-f2d660b3-3d65-4336-9179-c079631ac254 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-unplugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Instance destroyed successfully.
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.objects.instance [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lazy-loading 'resources' on Instance uuid c48c0202-2e70-4ab8-940a-3a235b69a018 {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T14:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539920072',display_name='tempest-VolumesActionsTest-instance-539920072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539920072',id=52,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T14:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b78a1e15b244c09a501c4e3e0e62d8b',ramdisk_id='',reservation_id='r-r00sbd5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1297646649',owner_user_name='tempest-VolumesActionsTest-1297646649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T14:57:50Z,user_data=None,user_id='86af32db1f4a4ac1bbfe51b80f82e966',uuid=c48c0202-2e70-4ab8-940a-3a235b69a018,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converting VIF {"id": "52d30188-4a4e-475c-91d8-a73124bd2be1", "address": "fa:16:3e:ff:b0:1b", "network": {"id": "9556344e-ad64-4201-a06b-8a0ab22b590f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-174594719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78a1e15b244c09a501c4e3e0e62d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d30188-4a", "ovs_interfaceid": "52d30188-4a4e-475c-91d8-a73124bd2be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG os_vif [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52d30188-4a, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:45 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=533d9386-7b79-4cf8-b42a-a360c865ed3b) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 14:59:46 user nova-compute[75326]: INFO os_vif [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b0:1b,bridge_name='br-int',has_traffic_filtering=True,id=52d30188-4a4e-475c-91d8-a73124bd2be1,network=Network(9556344e-ad64-4201-a06b-8a0ab22b590f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d30188-4a')
Dec 06 14:59:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Deleting instance files /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018_del
Dec 06 14:59:46 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Deletion of /opt/stack/data/nova/instances/c48c0202-2e70-4ab8-940a-3a235b69a018_del complete
Dec 06 14:59:46 user nova-compute[75326]: INFO nova.compute.manager [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 06 14:59:46 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 14:59:46 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Took 0.81 seconds to deallocate network for instance.
Dec 06 14:59:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Deleted allocations for instance c48c0202-2e70-4ab8-940a-3a235b69a018
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-2e04241a-3454-4a8f-8f79-345a2b112344 tempest-VolumesActionsTest-1297646649 tempest-VolumesActionsTest-1297646649-project-member] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:59:47 user nova-compute[75326]: WARNING nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state deleted and task_state None.
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:59:47 user nova-compute[75326]: WARNING nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state deleted and task_state None.
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:59:47 user nova-compute[75326]: WARNING nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state deleted and task_state None.
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Acquiring lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] Lock "c48c0202-2e70-4ab8-940a-3a235b69a018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] No waiting events found dispatching network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 14:59:47 user nova-compute[75326]: WARNING nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received unexpected event network-vif-plugged-52d30188-4a4e-475c-91d8-a73124bd2be1 for instance with vm_state deleted and task_state None.
Dec 06 14:59:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-363a81e5-884f-44a2-b135-742cfa897b52 req-249dad9e-172d-4c95-9e90-e20beb6fb1b5 service nova] [instance: c48c0202-2e70-4ab8-940a-3a235b69a018] Received event network-vif-deleted-52d30188-4a4e-475c-91d8-a73124bd2be1 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 14:59:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 14:59:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:00:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:00:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:00:17 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:00:17 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9213MB free_disk=25.160816192626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:00:17 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:00:18 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:00:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:00:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:00:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:00:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:00:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:01:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:12 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:13 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:01:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:01:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:01:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 15:01:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:01:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:01:19 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:01:19 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9220MB free_disk=25.158920288085938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:01:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:01:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:01:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:30 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:01:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:01:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:01:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:15 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:02:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:02:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:02:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:02:17 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 15:02:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:02:21 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:02:21 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:02:21 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.1568603515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:02:21 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:02:22 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:02:22 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:02:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:02:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:23 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:27 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:02:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:37 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Starting instance... {{(pid=75326) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75326) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 15:02:43 user nova-compute[75326]: INFO nova.compute.claims [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Claim successful on node user
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Start building networks asynchronously for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Allocating IP information in the background. {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] allocate_for_instance() {{(pid=75326) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 15:02:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Start building block device mappings for instance. {{(pid=75326) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 15:02:43 user nova-compute[75326]: DEBUG nova.policy [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbcbf4b1eb544f3a9936bdb4dc61198a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d853d96a3240aca5964bdf776fa672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75326) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Start spawning the instance on the hypervisor. {{(pid=75326) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Creating instance directory {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 15:02:44 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Creating image(s)
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "/opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "/opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.194s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.209s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk 1073741824 {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576,backing_fmt=raw /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk 1073741824" returned: 0 in 0.294s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "bf3e20e0aa9f57e606845bc0332c9e7c572c1576" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.511s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Successfully created port: a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf3e20e0aa9f57e606845bc0332c9e7c572c1576 --force-share --output=json" returned: 0 in 0.213s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk. size=1073741824 {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 15:02:44 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.disk.api [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Cannot resize image /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk to a smaller size. {{(pid=75326) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Created local disks {{(pid=75326) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Ensure instance console log exists: /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/console.log {{(pid=75326) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Successfully updated port: a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Building network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-changed-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.compute.manager [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Refreshing instance network info cache due to event network-changed-a8914e4b-ae94-49d4-8654-342977bf7594. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Instance cache missing network info. {{(pid=75326) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.network.neutron [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Instance network_info: |[{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75326) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Refreshing network info cache for port a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Start _get_guest_xml network_info=[{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'fe7426de-1c65-4621-9c71-22fe165b8041'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 15:02:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:02:45 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CPU controller missing on host. {{(pid=75326) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.host [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CPU controller found on host. {{(pid=75326) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75326) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T14:02:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=fe7426de-1c65-4621-9c71-22fe165b8041,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d8930b8b4524c469a40c067b22dcf2f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flavor limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Image limits 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flavor pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Image pref 0:0:0 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 15:02:45 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Got 1 possible topologies {{(pid=75326) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.hardware [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75326) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T15:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099813238',display_name='tempest-SnapshotDataIntegrityTests-server-1099813238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099813238',id=53,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVCrjpjJIEtMY6py2Io5oJB1zifHXfYk8Qugd6OR44Q4K6zEHUpaEgh/++MTGHG7cZEEW14JCefPjGpJpNelq3fOnEgy8S2gpc4tQfToH5M5gfvmpN1UCaVGBAY0ov8A==',key_name='tempest-keypair-801825588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20d853d96a3240aca5964bdf776fa672',ramdisk_id='',reservation_id='r-mr3ucgzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1158180650',owner_user_name='tempest-SnapshotDataIntegrityTests-1158180650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T15:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcbf4b1eb544f3a9936bdb4dc61198a',uuid=dd5ff71f-65a7-4b09-9653-b551c081436b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75326) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converting VIF {"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.objects.instance [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'pci_devices' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 15:02:46 user nova-compute[75326]:   <uuid>dd5ff71f-65a7-4b09-9653-b551c081436b</uuid>
Dec 06 15:02:46 user nova-compute[75326]:   <name>instance-00000035</name>
Dec 06 15:02:46 user nova-compute[75326]:   <memory>524288</memory>
Dec 06 15:02:46 user nova-compute[75326]:   <vcpu>1</vcpu>
Dec 06 15:02:46 user nova-compute[75326]:   <metadata>
Dec 06 15:02:46 user nova-compute[75326]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 15:02:46 user nova-compute[75326]:       <nova:package version="0.0.0"/>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1099813238</nova:name>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:creationTime>2023-12-06 15:02:45</nova:creationTime>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:flavor name="m1.tiny">
Dec 06 15:02:46 user nova-compute[75326]:         <nova:memory>512</nova:memory>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:disk>1</nova:disk>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:swap>0</nova:swap>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:vcpus>1</nova:vcpus>
Dec 06 15:02:46 user nova-compute[75326]:       </nova:flavor>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:owner>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:user uuid="fbcbf4b1eb544f3a9936bdb4dc61198a">tempest-SnapshotDataIntegrityTests-1158180650-project-member</nova:user>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:project uuid="20d853d96a3240aca5964bdf776fa672">tempest-SnapshotDataIntegrityTests-1158180650</nova:project>
Dec 06 15:02:46 user nova-compute[75326]:       </nova:owner>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:root type="image" uuid="fe7426de-1c65-4621-9c71-22fe165b8041"/>
Dec 06 15:02:46 user nova-compute[75326]:       <nova:ports>
Dec 06 15:02:46 user nova-compute[75326]:         <nova:port uuid="a8914e4b-ae94-49d4-8654-342977bf7594">
Dec 06 15:02:46 user nova-compute[75326]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 15:02:46 user nova-compute[75326]:         </nova:port>
Dec 06 15:02:46 user nova-compute[75326]:       </nova:ports>
Dec 06 15:02:46 user nova-compute[75326]:     </nova:instance>
Dec 06 15:02:46 user nova-compute[75326]:   </metadata>
Dec 06 15:02:46 user nova-compute[75326]:   <sysinfo type="smbios">
Dec 06 15:02:46 user nova-compute[75326]:     <system>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="product">OpenStack Nova</entry>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="version">0.0.0</entry>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="serial">dd5ff71f-65a7-4b09-9653-b551c081436b</entry>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="uuid">dd5ff71f-65a7-4b09-9653-b551c081436b</entry>
Dec 06 15:02:46 user nova-compute[75326]:       <entry name="family">Virtual Machine</entry>
Dec 06 15:02:46 user nova-compute[75326]:     </system>
Dec 06 15:02:46 user nova-compute[75326]:   </sysinfo>
Dec 06 15:02:46 user nova-compute[75326]:   <os>
Dec 06 15:02:46 user nova-compute[75326]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 15:02:46 user nova-compute[75326]:     <boot dev="hd"/>
Dec 06 15:02:46 user nova-compute[75326]:     <smbios mode="sysinfo"/>
Dec 06 15:02:46 user nova-compute[75326]:   </os>
Dec 06 15:02:46 user nova-compute[75326]:   <features>
Dec 06 15:02:46 user nova-compute[75326]:     <acpi/>
Dec 06 15:02:46 user nova-compute[75326]:     <apic/>
Dec 06 15:02:46 user nova-compute[75326]:     <vmcoreinfo/>
Dec 06 15:02:46 user nova-compute[75326]:   </features>
Dec 06 15:02:46 user nova-compute[75326]:   <clock offset="utc">
Dec 06 15:02:46 user nova-compute[75326]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 15:02:46 user nova-compute[75326]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 15:02:46 user nova-compute[75326]:     <timer name="hpet" present="no"/>
Dec 06 15:02:46 user nova-compute[75326]:   </clock>
Dec 06 15:02:46 user nova-compute[75326]:   <cpu mode="custom" match="exact">
Dec 06 15:02:46 user nova-compute[75326]:     <model>Nehalem</model>
Dec 06 15:02:46 user nova-compute[75326]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 15:02:46 user nova-compute[75326]:   </cpu>
Dec 06 15:02:46 user nova-compute[75326]:   <devices>
Dec 06 15:02:46 user nova-compute[75326]:     <disk type="file" device="disk">
Dec 06 15:02:46 user nova-compute[75326]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 15:02:46 user nova-compute[75326]:       <source file="/opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk"/>
Dec 06 15:02:46 user nova-compute[75326]:       <target dev="vda" bus="virtio"/>
Dec 06 15:02:46 user nova-compute[75326]:     </disk>
Dec 06 15:02:46 user nova-compute[75326]:     <interface type="ethernet">
Dec 06 15:02:46 user nova-compute[75326]:       <mac address="fa:16:3e:77:50:25"/>
Dec 06 15:02:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 15:02:46 user nova-compute[75326]:       <mtu size="1442"/>
Dec 06 15:02:46 user nova-compute[75326]:       <target dev="tapa8914e4b-ae"/>
Dec 06 15:02:46 user nova-compute[75326]:     </interface>
Dec 06 15:02:46 user nova-compute[75326]:     <serial type="pty">
Dec 06 15:02:46 user nova-compute[75326]:       <log file="/opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/console.log" append="off"/>
Dec 06 15:02:46 user nova-compute[75326]:     </serial>
Dec 06 15:02:46 user nova-compute[75326]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 15:02:46 user nova-compute[75326]:     <video>
Dec 06 15:02:46 user nova-compute[75326]:       <model type="virtio"/>
Dec 06 15:02:46 user nova-compute[75326]:     </video>
Dec 06 15:02:46 user nova-compute[75326]:     <rng model="virtio">
Dec 06 15:02:46 user nova-compute[75326]:       <backend model="random">/dev/urandom</backend>
Dec 06 15:02:46 user nova-compute[75326]:     </rng>
Dec 06 15:02:46 user nova-compute[75326]:     <controller type="usb" index="0" model="none"/>
Dec 06 15:02:46 user nova-compute[75326]:     <memballoon model="virtio">
Dec 06 15:02:46 user nova-compute[75326]:       <stats period="10"/>
Dec 06 15:02:46 user nova-compute[75326]:     </memballoon>
Dec 06 15:02:46 user nova-compute[75326]:   </devices>
Dec 06 15:02:46 user nova-compute[75326]: </domain>
Dec 06 15:02:46 user nova-compute[75326]:  {{(pid=75326) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T15:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099813238',display_name='tempest-SnapshotDataIntegrityTests-server-1099813238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099813238',id=53,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVCrjpjJIEtMY6py2Io5oJB1zifHXfYk8Qugd6OR44Q4K6zEHUpaEgh/++MTGHG7cZEEW14JCefPjGpJpNelq3fOnEgy8S2gpc4tQfToH5M5gfvmpN1UCaVGBAY0ov8A==',key_name='tempest-keypair-801825588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20d853d96a3240aca5964bdf776fa672',ramdisk_id='',reservation_id='r-mr3ucgzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1158180650',owner_user_name='tempest-SnapshotDataIntegrityTests-1158180650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T15:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcbf4b1eb544f3a9936bdb4dc61198a',uuid=dd5ff71f-65a7-4b09-9653-b551c081436b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converting VIF {"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG os_vif [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae') {{(pid=75326) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1de81697-eeea-5018-b4ff-c8b147d952f4', '_type': 'linux-noop'}}, row=False) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8914e4b-ae, may_exist=True, interface_attrs={}) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8914e4b-ae, col_values=(('qos', UUID('fdef8b54-fa0e-4a50-ba10-2988e97dd457')),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8914e4b-ae, col_values=(('external_ids', {'iface-id': 'a8914e4b-ae94-49d4-8654-342977bf7594', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:50:25', 'vm-uuid': 'dd5ff71f-65a7-4b09-9653-b551c081436b'}),), if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:46 user nova-compute[75326]: INFO os_vif [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae')
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No VIF found with MAC fa:16:3e:77:50:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated VIF entry in instance network info cache for port a8914e4b-ae94-49d4-8654-342977bf7594. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG nova.network.neutron [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:02:46 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-4c00cd02-96b5-441d-8ba4-8a9ad683ba2f req-395be99a-8ee9-42ce-9fb2-204b31f33f03 service nova] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:47 user nova-compute[75326]: DEBUG nova.compute.manager [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:02:47 user nova-compute[75326]: WARNING nova.compute.manager [req-f2e0c58f-5654-4f27-8b2e-647e80b6a087 req-60c618ec-03fa-4f64-8251-9e50aa69516b service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state building and task_state spawning.
Dec 06 15:02:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:48 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.compute.manager [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:02:49 user nova-compute[75326]: WARNING nova.compute.manager [req-ea92d856-df23-4fc3-b25e-8d27c6e6ab3b req-eb45c325-ea21-4cb1-8013-cae1d184188d service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state building and task_state spawning.
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Instance event wait completed in 0 seconds for  {{(pid=75326) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Guest created on hypervisor {{(pid=75326) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 15:02:49 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Instance spawned successfully.
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_cdrom_bus of ide {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_disk_bus of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_input_bus of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_pointer_model of None {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_video_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Found default for hw_vif_model of virtio {{(pid=75326) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 15:02:50 user nova-compute[75326]: INFO nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Took 6.03 seconds to spawn the instance on the hypervisor.
Dec 06 15:02:50 user nova-compute[75326]: DEBUG nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Checking state {{(pid=75326) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 15:02:50 user nova-compute[75326]: INFO nova.compute.manager [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Took 6.74 seconds to build instance.
Dec 06 15:02:50 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-c08a314a-af09-4d5d-9713-9e8301c13aa5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.867s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:02:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:02:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:03:09 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:14 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:16 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:03:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:03:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:03:19 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:03:19 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:03:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:03:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:03:21 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:03:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:03:22 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.11306381225586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:03:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:03:25 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_power_states {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:28 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Triggering sync for uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 15:03:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:03:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:03:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:31 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:37 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 15:03:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:42 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:03:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 15:03:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 15:03:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:03:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:03:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:04:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:04:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:04:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:04:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:04:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:23 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:24 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:04:24 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.103683471679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:04:24 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:04:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:04:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:32 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-changed-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG nova.compute.manager [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Refreshing instance network info cache due to event network-changed-a8914e4b-ae94-49d4-8654-342977bf7594. {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG nova.network.neutron [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Refreshing network info cache for port a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 15:04:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated VIF entry in instance network info cache for port a8914e4b-ae94-49d4-8654-342977bf7594. {{(pid=75326) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 15:04:35 user nova-compute[75326]: DEBUG nova.network.neutron [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:04:35 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-83b1e117-beae-4d8b-bb3d-561c4aa1328e req-9b4dda69-69c3-482b-922c-2b92d3aa116a service nova] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:04:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:04:38 user nova-compute[75326]: INFO nova.compute.manager [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attaching volume 37865812-8d37-446a-88ab-66220dccc49c to /dev/vdb
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.utils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c146f47-58a7-4e25-b1c0-af3f9667fec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f0019e-b2f7-4a90-9ec7-1107f8b8c97c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c645ab-71f9-46eb-a032-ea681e78b6a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7449524-a2fa-413f-a91c-18798c39b7d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:04:38 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 15:04:38 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69f245-f709-44e3-86bc-f27c25a8a851]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG os_brick.utils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:04:38 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating existing volume attachment record: db507f31-12f5-45bc-8009-a77af41c2e42 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 15:04:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkdFiYoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:04:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:04:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:04:47 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d937175-8a2b-4b72-9d88-45fcbe866c9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 15:04:47 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c998d54-bc79-45fa-9f4e-4ef6471efe95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c] added
Dec 06 15:04:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553ad62-0ddb-4196-a685-5d5538767e9f]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[851992fe-28df-41c2-8505-4391900bf6df]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkdFiYoc {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkdFiYoc" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10da464-b490-4c75-9e5e-8de97e8f1622]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkdFiYoc'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e10b9f-84fc-43ee-9576-a43bfd2905a8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8aaefc-2e90-4204-bf2e-960ff8e62a8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:04:47 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:04:47 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:04:47 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 15:04:47 user nova-compute[75326]: 
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524af22-975f-4c2a-8cf3-9c48c128d6dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260]
Dec 06 15:04:47 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260] successful.
Dec 06 15:04:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf0a71b-0d8c-4a7a-adb3-43e91f23fad2]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[630509a5-e214-472b-ac01-2605ad97acac]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)
Dec 06 15:04:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)
Dec 06 15:04:47 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcfc7ea-8618-4f5c-98d1-968e4872f00c]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:04:47 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkdFiYoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26431663232333063', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431663232333063', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 15:04:48 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 15:04:49 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:04:49 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:04:49 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:04:49 user nova-compute[75326]:   <serial>37865812-8d37-446a-88ab-66220dccc49c</serial>
Dec 06 15:04:49 user nova-compute[75326]: </disk>
Dec 06 15:04:49 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No VIF found with MAC fa:16:3e:77:50:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7c99bdb-f7bb-4efd-a5c5-a40f233a89f7 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.257s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:04:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:04:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:05:09 user nova-compute[75326]: INFO nova.compute.manager [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Detaching volume 37865812-8d37-446a-88ab-66220dccc49c
Dec 06 15:05:09 user nova-compute[75326]: INFO nova.virt.block_device [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attempting to driver detach volume 37865812-8d37-446a-88ab-66220dccc49c from mountpoint /dev/vdb
Dec 06 15:05:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Attempting to detach device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:05:09 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:05:09 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:05:09 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:05:09 user nova-compute[75326]:   <serial>37865812-8d37-446a-88ab-66220dccc49c</serial>
Dec 06 15:05:09 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:05:09 user nova-compute[75326]: </disk>
Dec 06 15:05:09 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:05:09 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config.
Dec 06 15:05:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:05:09 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:05:09 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:05:09 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:05:09 user nova-compute[75326]:   <serial>37865812-8d37-446a-88ab-66220dccc49c</serial>
Dec 06 15:05:09 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:05:09 user nova-compute[75326]: </disk>
Dec 06 15:05:09 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 15:05:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:15 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:05:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:05:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:05:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:05:26 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9071MB free_disk=25.102310180664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:05:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:05:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b is timed out.
Dec 06 15:05:29 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config.
Dec 06 15:05:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkdFiYoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:05:29 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb375e-0d57-451b-8898-64851e58cd1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 15:05:29 user nova-compute[75326]: No targets found.
Dec 06 15:05:29 user nova-compute[75326]: iSNS:
Dec 06 15:05:29 user nova-compute[75326]: No targets found.
Dec 06 15:05:29 user nova-compute[75326]: STATIC:
Dec 06 15:05:29 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c
Dec 06 15:05:29 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 15:05:29 user nova-compute[75326]:                 Iface Name: default
Dec 06 15:05:29 user nova-compute[75326]: FIRMWARE:
Dec 06 15:05:29 user nova-compute[75326]: No targets found.
Dec 06 15:05:29 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 15:05:29 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 15:05:29 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[924ae792-32ac-43ae-962b-ad7ac5763c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e4bb7-2766-4563-b0ea-0f5c5fb8887d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)
Dec 06 15:05:29 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c (non-flash)
Dec 06 15:05:29 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb44dc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8e4484-54af-4a7e-8382-8fe453eb072e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667093f-e22e-402b-b53c-26f844487686]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f671b6-3dc1-45c5-bfbd-2ecc147fc25e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e85e2e-c029-4b0d-bdf7-b80f13ad5fe2]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[249a396b-e17a-4c30-9010-f5d4326b31a8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029e8c0-0d79-4081-a149-0f8460ba9b0d]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260]
Dec 06 15:05:29 user nova-compute[75326]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c, portal: 172.16.0.220,3260] successful.
Dec 06 15:05:29 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37865812-8d37-446a-88ab-66220dccc49c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd92fa5-887a-4a48-8882-23abf08c97e5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== disconnect_volume: return (280ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:05:29 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 15:05:30 user nova-compute[75326]: DEBUG nova.objects.instance [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:05:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-6f175148-b046-49fb-bb85-308cf14cdfdd tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:05:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:05:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:05:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:05:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:06:02 user nova-compute[75326]: INFO nova.compute.manager [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attaching volume f849a4c6-0586-47a2-810d-d5ee82b4ba1d to /dev/vdb
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.utils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfdae2c-2200-4655-8c9d-5de48a32261f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c320afd-63b7-4c94-9081-a22320b49545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a337e0-fc97-43af-8a4d-dfbd0528137c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82c4c9-9542-4f4b-b9b4-b24dd5079259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:06:02 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 15:06:02 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099d094-1b25-4c64-aeb6-03ed41063c36]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG os_brick.utils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:06:02 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating existing volume attachment record: 80cfee9b-e6da-4dda-81e8-174daeb8bf38 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 15:06:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQrKAGnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:06:11 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:06:11 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:06:11 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[468cd158-9e2f-4efe-b156-9cf3e0e0b286]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 15:06:11 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6346c-8f35-47da-bb82-3e81ecb463bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d] added
Dec 06 15:06:11 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[042598eb-ddc0-45ff-95f4-6d6f693be2d1]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab44108-3ca5-4a05-964f-386df8acfebf]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQrKAGnJ {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQrKAGnJ" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d40c6ca-1d84-4614-9cc5-24af74eec7f6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQrKAGnJ'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:11 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f65b1-bce3-4bc0-8347-b8ab806dd822]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ac2da-5c78-4345-b7b4-9a7c6fca202e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:06:12 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:06:12 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:06:12 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 15:06:12 user nova-compute[75326]: 
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f667ba-8565-41f2-a394-bafcfb9a046a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260]
Dec 06 15:06:12 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260] successful.
Dec 06 15:06:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b992dfe0-05ca-4cae-95dc-9ca77ae33909]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[10629088-4bee-488e-ad8a-fb18867768be]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)
Dec 06 15:06:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)
Dec 06 15:06:12 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a26d690-a568-4fe0-9889-3e1ab682b1e0]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 15:06:12 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQrKAGnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23634366364343338', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634366364343338', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 15:06:13 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:06:13 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:06:13 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:06:13 user nova-compute[75326]:   <serial>f849a4c6-0586-47a2-810d-d5ee82b4ba1d</serial>
Dec 06 15:06:13 user nova-compute[75326]: </disk>
Dec 06 15:06:13 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No VIF found with MAC fa:16:3e:77:50:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 15:06:13 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e7364dc8-b56c-431f-a7a0-21569a182be5 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.325s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:06:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:06:15 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:06:16 user nova-compute[75326]: INFO nova.compute.manager [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Detaching volume f849a4c6-0586-47a2-810d-d5ee82b4ba1d
Dec 06 15:06:16 user nova-compute[75326]: INFO nova.virt.block_device [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attempting to driver detach volume f849a4c6-0586-47a2-810d-d5ee82b4ba1d from mountpoint /dev/vdb
Dec 06 15:06:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Attempting to detach device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 15:06:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:06:16 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:06:16 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:06:16 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:06:16 user nova-compute[75326]:   <serial>f849a4c6-0586-47a2-810d-d5ee82b4ba1d</serial>
Dec 06 15:06:16 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:06:16 user nova-compute[75326]: </disk>
Dec 06 15:06:16 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:06:16 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config.
Dec 06 15:06:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 15:06:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:06:16 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:06:16 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:06:16 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:06:16 user nova-compute[75326]:   <serial>f849a4c6-0586-47a2-810d-d5ee82b4ba1d</serial>
Dec 06 15:06:16 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:06:16 user nova-compute[75326]: </disk>
Dec 06 15:06:16 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:06:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:16 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 15:06:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:06:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:06:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:06:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:06:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:06:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:06:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:06:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.101253509521484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:06:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:06:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:36 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b is timed out.
Dec 06 15:06:36 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config.
Dec 06 15:06:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQrKAGnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:06:36 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3369a4bb-b8c0-4682-8c64-f27bbfcebdc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 15:06:36 user nova-compute[75326]: No targets found.
Dec 06 15:06:36 user nova-compute[75326]: iSNS:
Dec 06 15:06:36 user nova-compute[75326]: No targets found.
Dec 06 15:06:36 user nova-compute[75326]: STATIC:
Dec 06 15:06:36 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d
Dec 06 15:06:36 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 15:06:36 user nova-compute[75326]:                 Iface Name: default
Dec 06 15:06:36 user nova-compute[75326]: FIRMWARE:
Dec 06 15:06:36 user nova-compute[75326]: No targets found.
Dec 06 15:06:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 15:06:36 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 15:06:36 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46c3a7-2647-4028-a55a-e93d8adf77cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17f052-c8da-4028-a9ff-22375ab60cdc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)
Dec 06 15:06:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d (non-flash)
Dec 06 15:06:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4493b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fdb67e-0492-43d6-be22-d5833835252d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba2baf-4c6b-49a3-987b-5dd0a3e2db24]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65de28d-1df0-42c7-a357-a45127e1d282]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e799ddcf-d55b-46c2-9026-262f57d2f77e]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f552848-307e-4177-9e78-ef3fbef975e0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b2bff-56d3-4347-a531-c0042df6e67b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260]
Dec 06 15:06:36 user nova-compute[75326]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d, portal: 172.16.0.220,3260] successful.
Dec 06 15:06:36 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849a4c6-0586-47a2-810d-d5ee82b4ba1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae5f01-e592-4a5b-a115-03d9a2943a5d]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== disconnect_volume: return (276ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:06:36 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 15:06:37 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:06:37 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a3288d7b-5353-4776-82c0-e9557eb023db tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.882s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:06:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:06:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:07:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:07:09 user nova-compute[75326]: INFO nova.compute.manager [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attaching volume d93bc78c-e91b-41e5-901e-25056426048a to /dev/vdb
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.utils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dbbac8-8f79-4e6c-8ca4-baa410772c7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed9c10-8c80-44f0-900f-50afb76be01a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5744b75-ed7d-49e5-b87a-b69e10307d73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce26c1-facc-4df8-90a2-39d87c256e55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:07:09 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 15:07:09 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5822bcf-0316-4ad0-8780-49d3422c5c60]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG os_brick.utils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:07:09 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating existing volume attachment record: c3f2890a-f144-4f11-b64c-b5cf70e5e332 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 15:07:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:11 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:07:16 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:18 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptILbTkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:07:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:07:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:07:19 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a857a1-4b2f-43c6-86b9-1e84c3ff629a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 15:07:19 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c1394-530d-4d34-ab62-04249b1de8c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a] added
Dec 06 15:07:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829759d-6262-4d68-a6ce-79663d2cea1c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a33f2de-a167-4221-9e7b-b298efa35bf6]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptILbTkf {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptILbTkf" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef3f648-d024-4150-8148-3efb70834a0e]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptILbTkf'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be5403c-b7e8-4d2a-8870-b8045d45a5e8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea3f98-15f0-4471-82bd-695dae97091e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:07:19 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:07:19 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:07:19 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 15:07:19 user nova-compute[75326]: 
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd2377-d461-4709-9251-737b4282652b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260]
Dec 06 15:07:19 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260] successful.
Dec 06 15:07:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e986d5-cfea-4388-a7a6-7973a10c90a0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[95160cc5-c6fa-41ce-a823-d40bd8f62fc7]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)
Dec 06 15:07:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)
Dec 06 15:07:19 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b49df-9055-42da-849b-0d8aefbe434e]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 15:07:19 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptILbTkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23632636661616565', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632636661616565', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.objects.instance [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 15:07:20 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:07:20 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:07:20 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:07:20 user nova-compute[75326]:   <serial>d93bc78c-e91b-41e5-901e-25056426048a</serial>
Dec 06 15:07:20 user nova-compute[75326]: </disk>
Dec 06 15:07:20 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No VIF found with MAC fa:16:3e:77:50:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 15:07:20 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-a9287088-94de-41bc-b988-736c1cb3f282 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.261s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:07:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:07:22 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:07:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:07:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:07:23 user nova-compute[75326]: INFO nova.compute.manager [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Detaching volume d93bc78c-e91b-41e5-901e-25056426048a
Dec 06 15:07:23 user nova-compute[75326]: INFO nova.virt.block_device [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attempting to driver detach volume d93bc78c-e91b-41e5-901e-25056426048a from mountpoint /dev/vdb
Dec 06 15:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Attempting to detach device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 15:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:07:23 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:07:23 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:07:23 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:07:23 user nova-compute[75326]:   <serial>d93bc78c-e91b-41e5-901e-25056426048a</serial>
Dec 06 15:07:23 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:07:23 user nova-compute[75326]: </disk>
Dec 06 15:07:23 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:07:23 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config.
Dec 06 15:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 15:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:07:23 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:07:23 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:07:23 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:07:23 user nova-compute[75326]:   <serial>d93bc78c-e91b-41e5-901e-25056426048a</serial>
Dec 06 15:07:23 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:07:23 user nova-compute[75326]: </disk>
Dec 06 15:07:23 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:07:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:23 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 15:07:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:07:27 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9052MB free_disk=25.10031509399414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:07:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:07:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:33 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:07:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:43 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b is timed out.
Dec 06 15:07:43 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config.
Dec 06 15:07:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptILbTkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:07:43 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b09d71-41dc-41d2-8ba8-03db36ad131a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 15:07:43 user nova-compute[75326]: No targets found.
Dec 06 15:07:43 user nova-compute[75326]: iSNS:
Dec 06 15:07:43 user nova-compute[75326]: No targets found.
Dec 06 15:07:43 user nova-compute[75326]: STATIC:
Dec 06 15:07:43 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a
Dec 06 15:07:43 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 15:07:43 user nova-compute[75326]:                 Iface Name: default
Dec 06 15:07:43 user nova-compute[75326]: FIRMWARE:
Dec 06 15:07:43 user nova-compute[75326]: No targets found.
Dec 06 15:07:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 15:07:43 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 15:07:43 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[de589f5b-6c3c-456d-8aa3-0bf5d2340c1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f52725-ae40-4b5d-bdd0-54f5148eaca9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)
Dec 06 15:07:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a (non-flash)
Dec 06 15:07:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb451c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1dcee3-1dbc-43ed-8278-be050f79dd14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e94b1-5e85-4bc5-af1b-157ecedb4611]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3836f-765b-4397-a311-737b1c0cf9e4]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[977b7ae8-ea05-4dbc-b8d5-5f4d29ac406e]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246aa2a-3a39-4e2d-862d-bb8789bfa173]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1a89a7-7eb5-4b81-a839-4e9b7687313f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260]
Dec 06 15:07:43 user nova-compute[75326]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a, portal: 172.16.0.220,3260] successful.
Dec 06 15:07:43 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93bc78c-e91b-41e5-901e-25056426048a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaab814-b1b0-4f6f-8b2d-29c8d42e5cec]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== disconnect_volume: return (290ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:07:43 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 15:07:44 user nova-compute[75326]: DEBUG nova.objects.instance [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:07:44 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-28c9feae-be30-4e7a-a70e-b54cf2dd664d tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:07:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:07:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:07:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:12 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:08:16 user nova-compute[75326]: INFO nova.compute.manager [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attaching volume f9511705-66bf-463b-9143-94ee84641395 to /dev/vdb
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.utils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae4854-1b3f-4438-b47b-151de6504bca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:962f31957910\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[32494104-ed54-4a57-a001-af9edf7ff1c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf12dd-2538-4a8a-9bdc-212c5f662cac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[126850a3-aeaa-449a-9305-5a5860bad970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Running cmd (subprocess): nvme version {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] 'nvme version' failed. Not Retrying. {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] nvme not present on system {{(pid=75326) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 15:08:16 user nova-compute[75326]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 15:08:16 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7c231-49ff-4834-8828-b1435c2f9578]: (4, '') {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75326) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] LIGHTOS: no hostnqn found. {{(pid=75326) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG os_brick.utils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:962f31957910', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:08:16 user nova-compute[75326]: DEBUG nova.virt.block_device [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating existing volume attachment record: b547b16f-cd5e-428b-a2e8-c952c89e71a3 {{(pid=75326) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 15:08:17 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:19 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:19 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:08:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:08:21 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:08:22 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:08:22 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:08:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:08:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Calling os-brick to attach iSCSI Volume {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wveIDVyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:08:25 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:08:25 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:08:25 user nova-compute[75326]: INFO os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb46401-08b8-404b-8226-3235ea6a83a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 15:08:25 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --interface default --op new {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc234c7a-1ddf-4a8c-81ab-46a58731d377]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395] added\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395] added
Dec 06 15:08:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef2633e-a362-47dd-9810-c099d0d3e280]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2f6c9d-a7f5-49d0-bc23-86ff6a1259d8]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wveIDVyx {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wveIDVyx" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f7716f-1b0b-42d7-a7b2-9c5c0f397b54]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wveIDVyx'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f7a417-91a3-46ea-ba80-30f8fe4a43a0]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f516ab1-a6ac-4310-b93e-647f72302e90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:08:25 user nova-compute[75326]:  {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 15:08:25 user nova-compute[75326]:  {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:08:25 user nova-compute[75326]: WARNING os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 15:08:25 user nova-compute[75326]: 
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --login {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[03355453-f20a-413f-821d-c9e5a4c5baaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260]
Dec 06 15:08:25 user nova-compute[75326]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260] successful.
Dec 06 15:08:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f1903e-bc86-4701-8a8f-7ed5f430c013]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a6e4f-8b02-4a64-818e-8fbe34b93145]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)
Dec 06 15:08:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)
Dec 06 15:08:25 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to 172.16.0.220:3260 {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75326) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75326) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 15:08:25 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0c03e-d0c3-41d9-bd5f-a8fb6a6b3a60]: (4, ('- - 0', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75326) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wveIDVyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75326) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23261353030366262', 'path': '/dev/sdb'} {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261353030366262', 'path': '/dev/sdb'} {{(pid=75326) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.objects.instance [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 15:08:27 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:08:27 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:08:27 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:08:27 user nova-compute[75326]:   <serial>f9511705-66bf-463b-9143-94ee84641395</serial>
Dec 06 15:08:27 user nova-compute[75326]: </disk>
Dec 06 15:08:27 user nova-compute[75326]:  {{(pid=75326) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vda, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75326) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] No VIF found with MAC fa:16:3e:77:50:25, not building metadata {{(pid=75326) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-5cb61dae-4adb-4d80-ad08-d8235f8a8516 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.407s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:27 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75326) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 15:08:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:08:28 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.09945297241211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:08:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:08:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:08:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:08:30 user nova-compute[75326]: INFO nova.compute.manager [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Detaching volume f9511705-66bf-463b-9143-94ee84641395
Dec 06 15:08:30 user nova-compute[75326]: INFO nova.virt.block_device [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Attempting to driver detach volume f9511705-66bf-463b-9143-94ee84641395 from mountpoint /dev/vdb
Dec 06 15:08:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Attempting to detach device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config. {{(pid=75326) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 15:08:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:08:30 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:08:30 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:08:30 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:08:30 user nova-compute[75326]:   <serial>f9511705-66bf-463b-9143-94ee84641395</serial>
Dec 06 15:08:30 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:08:30 user nova-compute[75326]: </disk>
Dec 06 15:08:30 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:08:30 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the persistent domain config.
Dec 06 15:08:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config. {{(pid=75326) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 15:08:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.guest [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 15:08:30 user nova-compute[75326]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 15:08:30 user nova-compute[75326]:   <source dev="/dev/sdb"/>
Dec 06 15:08:30 user nova-compute[75326]:   <target dev="vdb" bus="virtio"/>
Dec 06 15:08:30 user nova-compute[75326]:   <serial>f9511705-66bf-463b-9143-94ee84641395</serial>
Dec 06 15:08:30 user nova-compute[75326]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 15:08:30 user nova-compute[75326]: </disk>
Dec 06 15:08:30 user nova-compute[75326]:  {{(pid=75326) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 15:08:30 user nova-compute[75326]: DEBUG nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 15:08:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:08:43 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:43 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances with incomplete migration  {{(pid=75326) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 15:08:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Cleaning up deleted instances {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 15:08:44 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] There are 0 instances to clean {{(pid=75326) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 15:08:44 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:08:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:50 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd5ff71f-65a7-4b09-9653-b551c081436b is timed out.
Dec 06 15:08:50 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully detached device vdb from instance dd5ff71f-65a7-4b09-9653-b551c081436b from the live domain config.
Dec 06 15:08:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] calling os-brick to detach iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9bd4229de0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wveIDVyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 15:08:50 user nova-compute[75326]: WARNING os_brick.initiator.connectors.base [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad0775-8348-4b89-981a-43f1d0e886d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 15:08:50 user nova-compute[75326]: No targets found.
Dec 06 15:08:50 user nova-compute[75326]: iSNS:
Dec 06 15:08:50 user nova-compute[75326]: No targets found.
Dec 06 15:08:50 user nova-compute[75326]: STATIC:
Dec 06 15:08:50 user nova-compute[75326]: Target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395
Dec 06 15:08:50 user nova-compute[75326]:         Portal: 172.16.0.220:3260,-1
Dec 06 15:08:50 user nova-compute[75326]:                 Iface Name: default
Dec 06 15:08:50 user nova-compute[75326]: FIRMWARE:
Dec 06 15:08:50 user nova-compute[75326]: No targets found.
Dec 06 15:08:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 15:08:50 user nova-compute[75326]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 15:08:50 user nova-compute[75326]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75326) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395', 0)] {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502be8a-28c4-4a27-afe9-3fa3b1569b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc11a2a-aeed-4e2b-b9c6-f2086262495d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)
Dec 06 15:08:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 (non-flash)
Dec 06 15:08:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bb4380ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395'): ({'sdb'}, set())}) {{(pid=75326) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Removing single pathed devices sdb {{(pid=75326) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbf74a-13cf-4c8f-91a5-16bef7bd0c24]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5102a02-df96-49db-828a-005ec06e2b56]: (4, ('ok\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Flushing IO for device /dev/sdb {{(pid=75326) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18f021-0169-4560-bd27-35f714d5656c]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75326) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda7216e-bd28-4618-b41a-271c74de331f]: (4, ('1', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.linuxscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] SCSI volumes sdb have been removed. {{(pid=75326) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395')] {{(pid=75326) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc72528-ba2b-47fc-ad1e-d647dcbeb350]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --logout {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3403ce0b-d870-4c04-8f5e-02f06c4ee987]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260]
Dec 06 15:08:50 user nova-compute[75326]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395, portal: 172.16.0.220,3260] successful.
Dec 06 15:08:50 user nova-compute[75326]:  stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op delete {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9511705-66bf-463b-9143-94ee84641395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44371ab-ac4a-4521-bf40-517c12e94bd5]: (4, ('', '')) {{(pid=86439) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75326) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.base [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] <== disconnect_volume: return (286ms) None {{(pid=75326) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 15:08:50 user nova-compute[75326]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Disconnected iSCSI Volume {{(pid=75326) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 15:08:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:08:51 user nova-compute[75326]: DEBUG nova.objects.instance [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'flavor' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:08:51 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-e50b57a0-6569-4978-bf76-f4ac40ad2dd8 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:08:56 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:01 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:06 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:11 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:16 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:18 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:09:21 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquired lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Forcefully refreshing network info cache for instance {{(pid=75326) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.objects.instance [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lazy-loading 'info_cache' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.network.neutron [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [{"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Releasing lock "refresh_cache-dd5ff71f-65a7-4b09-9653-b551c081436b" {{(pid=75326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 15:09:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updated the network info_cache for instance {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 15:09:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:09:26 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 15:09:28 user nova-compute[75326]: DEBUG oslo_concurrency.processutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 15:09:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:09:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=25.098617553710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Instance dd5ff71f-65a7-4b09-9653-b551c081436b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75326) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing inventories for resource provider ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating ProviderTree inventory for provider ba07be03-a218-4efb-ac98-444d17eb9220 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Updating inventory in ProviderTree for provider ba07be03-a218-4efb-ac98-444d17eb9220 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing aggregate associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, aggregates: None {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Refreshing trait associations for resource provider ba07be03-a218-4efb-ac98-444d17eb9220, traits: COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75326) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:09:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:31 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:35 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:36 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:09:41 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:46 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:51 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:53 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:54 user nova-compute[75326]: INFO nova.compute.manager [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Terminating instance
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.compute.manager [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Start destroying the instance on the hypervisor. {{(pid=75326) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.compute.manager [req-79345123-b250-4cf9-8a08-d07a60999b60 req-fdfc384d-4ccc-4b6d-a54e-a552c0cde7db service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with task_state deleting. {{(pid=75326) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Instance destroyed successfully.
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.objects.instance [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lazy-loading 'resources' on Instance uuid dd5ff71f-65a7-4b09-9653-b551c081436b {{(pid=75326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.virt.libvirt.vif [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T15:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099813238',display_name='tempest-SnapshotDataIntegrityTests-server-1099813238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099813238',id=53,image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVCrjpjJIEtMY6py2Io5oJB1zifHXfYk8Qugd6OR44Q4K6zEHUpaEgh/++MTGHG7cZEEW14JCefPjGpJpNelq3fOnEgy8S2gpc4tQfToH5M5gfvmpN1UCaVGBAY0ov8A==',key_name='tempest-keypair-801825588',keypairs=<?>,launch_index=0,launched_at=2023-12-06T15:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20d853d96a3240aca5964bdf776fa672',ramdisk_id='',reservation_id='r-mr3ucgzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fe7426de-1c65-4621-9c71-22fe165b8041',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1158180650',owner_user_name='tempest-SnapshotDataIntegrityTests-1158180650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T15:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcbf4b1eb544f3a9936bdb4dc61198a',uuid=dd5ff71f-65a7-4b09-9653-b551c081436b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converting VIF {"id": "a8914e4b-ae94-49d4-8654-342977bf7594", "address": "fa:16:3e:77:50:25", "network": {"id": "bcaa5c29-9484-49d7-9647-42bc2f95274c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1218723443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20d853d96a3240aca5964bdf776fa672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8914e4b-ae", "ovs_interfaceid": "a8914e4b-ae94-49d4-8654-342977bf7594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.network.os_vif_util [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae') {{(pid=75326) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG os_vif [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae') {{(pid=75326) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8914e4b-ae, bridge=br-int, if_exists=True) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdef8b54-fa0e-4a50-ba10-2988e97dd457) {{(pid=75326) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:09:54 user nova-compute[75326]: INFO os_vif [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:50:25,bridge_name='br-int',has_traffic_filtering=True,id=a8914e4b-ae94-49d4-8654-342977bf7594,network=Network(bcaa5c29-9484-49d7-9647-42bc2f95274c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8914e4b-ae')
Dec 06 15:09:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Deleting instance files /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b_del
Dec 06 15:09:54 user nova-compute[75326]: INFO nova.virt.libvirt.driver [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Deletion of /opt/stack/data/nova/instances/dd5ff71f-65a7-4b09-9653-b551c081436b_del complete
Dec 06 15:09:54 user nova-compute[75326]: INFO nova.compute.manager [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 15:09:54 user nova-compute[75326]: DEBUG oslo.service.loopingcall [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75326) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.compute.manager [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Deallocating network for instance {{(pid=75326) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 15:09:54 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] deallocate_for_instance() {{(pid=75326) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG nova.network.neutron [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Updating instance_info_cache with network_info: [] {{(pid=75326) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 15:09:55 user nova-compute[75326]: INFO nova.compute.manager [-] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Took 0.93 seconds to deallocate network for instance.
Dec 06 15:09:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:55 user nova-compute[75326]: DEBUG nova.compute.manager [req-7da80fa6-8274-46b4-8998-9d5c790f3fba req-72002135-339f-428d-870e-bfd1e35f329d service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-deleted-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: INFO nova.scheduler.client.report [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Deleted allocations for instance dd5ff71f-65a7-4b09-9653-b551c081436b
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-019b0498-70ab-4231-a111-6bebdaa8f589 tempest-SnapshotDataIntegrityTests-1158180650 tempest-SnapshotDataIntegrityTests-1158180650-project-member] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:56 user nova-compute[75326]: WARNING nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state deleted and task_state None.
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:56 user nova-compute[75326]: WARNING nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state deleted and task_state None.
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:56 user nova-compute[75326]: WARNING nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state deleted and task_state None.
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:56 user nova-compute[75326]: WARNING nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-unplugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state deleted and task_state None.
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Acquiring lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] Lock "dd5ff71f-65a7-4b09-9653-b551c081436b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:09:56 user nova-compute[75326]: DEBUG nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] No waiting events found dispatching network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 {{(pid=75326) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 15:09:56 user nova-compute[75326]: WARNING nova.compute.manager [req-e47917d9-1985-44aa-bd61-3a18508aeb2d req-fe2ba510-b49f-4f13-8e2e-9e2934bde995 service nova] [instance: dd5ff71f-65a7-4b09-9653-b551c081436b] Received unexpected event network-vif-plugged-a8914e4b-ae94-49d4-8654-342977bf7594 for instance with vm_state deleted and task_state None.
Dec 06 15:09:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:10:23 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:10:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:10:23 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 15:10:24 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:27 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:10:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:10:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=25.125713348388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:10:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:34 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:10:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:47 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:50 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:10:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:20 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:20 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 15:11:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:24 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Starting heal instance info cache {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 15:11:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Rebuilding the list of instances to heal {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 15:11:25 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Didn't find any instances for network info cache update. {{(pid=75326) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 15:11:25 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager.update_available_resource {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Auditing locally available compute resources for user (node: user) {{(pid=75326) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 15:11:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:11:29 user nova-compute[75326]: WARNING nova.virt.libvirt.driver [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 15:11:29 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Hypervisor/Node resource view: name=user free_ram=9295MB free_disk=25.11737060546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75326) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:29 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75326) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG nova.compute.provider_tree [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed in ProviderTree for provider: ba07be03-a218-4efb-ac98-444d17eb9220 {{(pid=75326) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG nova.scheduler.client.report [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Inventory has not changed for provider ba07be03-a218-4efb-ac98-444d17eb9220 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75326) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG nova.compute.resource_tracker [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Compute_service record updated for user:user {{(pid=75326) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 15:11:30 user nova-compute[75326]: DEBUG oslo_concurrency.lockutils [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75326) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 15:11:34 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:37 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:39 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:40 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:11:44 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:49 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75326) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75326) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 15:11:54 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:11:59 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:12:04 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:12:09 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 15:12:13 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:12:14 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:12:19 user nova-compute[75326]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75326) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 15:12:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:12:22 user nova-compute[75326]: DEBUG oslo_service.periodic_task [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75326) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 15:12:22 user nova-compute[75326]: DEBUG nova.compute.manager [None req-4c488b8c-3ea2-41c2-aab1-230eb9b5512c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75326) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}